-- Logs begin at Mon 2021-11-22 15:54:30 UTC, end at Mon 2021-11-22 17:06:57 UTC. -- Nov 22 16:38:04.795375 dv-cinder-804735-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 16:38:04.805157 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 16:38:04 2021] *** Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: nodename: dv-cinder-804735-12-iscsi Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: machine: x86_64 Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: clock source: unix Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: pcre jit disabled Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: detected number of CPU cores: 4 Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: current working directory: / Nov 22 16:38:04.807115 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: detected binary path: /usr/bin/uwsgi-core Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: your processes number limit is 47680 Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: your memory page size is 4096 bytes Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: detected max file descriptor number: 2048 Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: lock engine: pthread robust mutexes Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: thunder lock: enabled Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 16:38:04.807802 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 16:38:04.853107 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: Python main interpreter initialized at 0x55b04b09f9c0 Nov 22 16:38:04.853107 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: python threads support enabled Nov 22 16:38:04.853107 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: your server socket listen backlog is limited to 100 connections Nov 22 16:38:04.853107 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: your mercy for graceful operations on workers is 90 seconds Nov 22 16:38:04.853463 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 16:38:04.853537 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: *** Operational MODE: preforking *** Nov 22 16:38:04.853807 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: *** uWSGI is running in multiple interpreter mode *** Nov 22 16:38:04.853807 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: spawned uWSGI master process (pid: 119024) Nov 22 16:38:04.854007 dv-cinder-804735-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 16:38:04.855781 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: spawned uWSGI worker 1 (pid: 119025, cores: 1) Nov 22 16:38:04.855781 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: spawned uWSGI worker 2 (pid: 119026, cores: 1) Nov 22 16:38:04.855781 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 16:38:06.470509 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:38:06.470509 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: from cryptography.utils import int_from_bytes Nov 22 16:38:06.471163 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:38:06.471163 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: from cryptography.utils import int_from_bytes Nov 22 16:38:06.472360 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:38:06.472360 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: from cryptography.utils import int_from_bytes Nov 22 16:38:06.472814 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:38:06.472814 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: from cryptography.utils import int_from_bytes Nov 22 16:38:08.998248 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 16:38:08.998732 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 16:38:08.998989 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 16:38:08.999351 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 16:38:08.999607 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 16:38:09.000016 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.000380 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.000704 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.001022 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.001347 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.001656 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.001974 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.002289 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.002541 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 16:38:09.002908 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.002984 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 16:38:09.003054 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.003174 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.003375 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 16:38:09.003538 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-12-iscsi {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.003703 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 16:38:09.003905 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.004068 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 16:38:09.004229 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.004380 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.004529 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.004666 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.004815 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.004969 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.005104 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.005228 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.005374 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.005506 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.005650 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.005825 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.006104 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.006220 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.007390 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.007601 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.007601 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.008000 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.008000 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.008342 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.008520 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.008706 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.008888 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-12-iscsi {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.009064 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.009064 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.009405 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.009580 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.009762 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.009943 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.010125 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.010330 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.010478 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.010651 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.010862 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.010862 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.011175 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-12-iscsi {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.011348 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.011531 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.011531 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.011884 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012044 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012207 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012446 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012575 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012710 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012864 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.012986 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013110 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013240 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013371 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013518 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013646 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013771 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.013890 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014017 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014142 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014268 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014388 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014519 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014654 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014781 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.014931 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-12-iscsi {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.015065 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.015192 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.015312 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.015431 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.015549 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.015676 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.016436 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.016436 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.016704 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.016824 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.016955 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017088 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017277 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017413 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017594 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017714 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017833 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.017961 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018088 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018216 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018330 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018458 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018587 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018715 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018843 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.018972 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019099 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019221 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019352 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019473 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019599 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019719 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019853 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019991 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.019991 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020232 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020232 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020458 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020576 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020707 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020827 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.020946 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021065 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021190 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021316 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021444 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021564 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021683 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021824 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.021951 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022083 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022204 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022322 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022449 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022626 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022826 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.022964 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.023086 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.023255 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.023378 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.023565 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.023689 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.023901 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024040 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024212 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024336 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024522 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024654 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024833 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.024962 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.025141 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.025265 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.025451 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.025585 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.025771 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.025901 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026091 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026223 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026474 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026618 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026740 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026865 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.026986 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.027104 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.027223 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.027421 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.027546 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.027666 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.027839 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028000 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028142 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028346 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028471 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028671 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028795 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.028985 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.029118 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.029304 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.029426 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.029609 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.029740 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.029915 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030052 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030219 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030343 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030523 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030646 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030822 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.030955 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.031125 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.031249 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.031526 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.032255 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.032396 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.032532 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.032655 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.032851 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.032977 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.033168 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.033300 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.033499 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.033630 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.033816 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.033940 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.034116 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.034248 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.034429 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.034552 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.034735 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.034858 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035037 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035168 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035350 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035472 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035653 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035782 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.035983 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.036121 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.036291 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.036414 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.036598 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.036717 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.036906 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037088 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037213 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037344 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037508 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037638 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037812 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.037947 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.038126 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.038251 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.038432 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.038566 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.038735 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.038859 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039038 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039170 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039341 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039463 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039642 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039774 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.039968 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040093 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040269 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040392 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040569 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040693 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040864 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.040987 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.041181 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.041303 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.041499 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.041622 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.041805 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.041927 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.042107 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.042229 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.042411 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.042535 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.042716 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.042844 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.043024 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.043148 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.043351 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.043482 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.043661 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.043784 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.043994 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.044135 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.044305 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.044430 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.044614 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.044738 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.044924 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.045060 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.045234 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.045358 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.045544 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.045673 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.045853 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.045985 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.046158 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.046282 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.046467 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.046596 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.046814 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.046939 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.047104 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.047228 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.047423 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.047735 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.047889 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.048077 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.048208 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.048391 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.048512 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:38:09.048710 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.048977 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049111 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049236 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049362 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049499 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049640 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049771 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.049961 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.050083 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.050270 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.050398 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.050611 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.050758 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.050953 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.051076 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.051270 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.051405 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.051578 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.051710 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.051917 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052041 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052240 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052365 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052552 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052675 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052865 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.052997 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.053178 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.053309 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.053511 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.053640 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.053824 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.053948 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.054137 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.054260 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.054458 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.054581 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.054775 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.054900 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.055090 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.055212 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.055397 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.055530 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.055703 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.055859 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056036 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056167 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056353 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056477 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056661 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056804 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.056992 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.057126 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.057301 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.057425 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.057609 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.057732 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.057940 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.058079 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.058247 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.058374 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.058559 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.058680 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.058868 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059066 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059191 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059317 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059470 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059593 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059782 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.059949 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.060111 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.060242 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.060434 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.060559 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.060747 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.060877 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061052 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061178 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061359 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061482 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061668 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061793 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.061973 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.062096 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.062280 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.062401 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.062589 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.063204 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.063496 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.063647 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.063935 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.064073 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.064265 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.064391 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.064581 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.064704 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.064893 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065044 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065209 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065332 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065520 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065644 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065837 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.065969 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.066153 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.066276 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.066461 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.066584 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.066782 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.066912 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.067141 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.067269 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.067389 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.067520 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.067679 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.067812 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068011 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068135 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068316 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068440 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068627 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068752 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.068930 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069081 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069235 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069359 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069541 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069670 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069846 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.069969 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.070149 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.070273 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.070468 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.070592 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.070776 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.070905 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.071081 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.071207 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.071386 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.071511 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.071690 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.071815 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.072057 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.072194 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.072363 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.072488 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.072690 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.072813 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073007 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073165 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073320 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073445 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073630 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073755 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.073939 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.074071 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.074255 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.074378 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.074566 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.074696 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.074875 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.075006 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.075181 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.075305 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.075489 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.075611 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.075797 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076015 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076137 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076255 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076434 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076569 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076743 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.076866 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077053 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077262 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077388 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077508 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077666 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077790 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.077971 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.078095 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.078938 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.079074 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.079289 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.079546 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.079968 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.080158 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.080282 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.080493 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.080617 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.080816 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.080951 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.081130 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.081259 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.081443 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.081568 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.081756 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.081889 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.082066 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.082190 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.082377 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.082501 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.082694 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.082817 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083006 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083135 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083324 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083448 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083634 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083764 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.083979 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.084104 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.084292 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.084417 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.084611 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.084734 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.084914 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.085046 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.085232 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.085354 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.085557 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.085680 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.085887 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086022 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086197 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086320 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086509 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086639 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086824 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.086954 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.087130 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.087272 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.087460 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.087590 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.087737 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.087893 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088067 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088197 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088373 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088496 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088683 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088814 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.088995 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.089117 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.089304 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.089424 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.089619 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.089741 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.089905 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090027 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090217 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090339 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090524 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090649 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090828 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.090951 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.091131 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.091261 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.091440 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.091564 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.091760 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.091928 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.092101 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.092232 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.092419 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.092540 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.092737 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.092857 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.093040 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.093172 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.093342 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.093465 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.093656 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.093785 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.094006 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.094136 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.094315 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.094549 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.094705 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.094859 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.095012 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.095181 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.095363 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.095674 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.096024 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.096272 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.096403 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.096595 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.096696 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.096915 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.097013 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.097225 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.097353 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.097533 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.097624 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.097842 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.098161 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.098474 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.098581 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.098782 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.098879 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.099090 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.099176 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.099399 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.099506 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.099709 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.099797 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.100099 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.100213 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.100474 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.100574 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.100787 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.100874 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.101099 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.101186 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.101409 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.101497 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.101712 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.101806 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.102022 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.102109 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.102341 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.102435 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.102656 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.102915 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.103002 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.103252 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.103351 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.103572 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.103666 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.103937 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104027 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104266 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104365 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104583 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104676 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104901 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.104987 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.105222 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.105309 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.105539 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.105700 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.105935 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106090 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106236 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106374 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106509 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106643 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106777 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.106918 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107067 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107208 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107344 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107485 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107620 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107753 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.107965 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108103 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108238 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108374 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108516 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108658 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108794 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.108934 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.109125 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.109266 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.109517 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.109764 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.109980 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.110141 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.110317 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.110635 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.110943 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.111082 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.111267 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.111431 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.111580 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.111758 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.111923 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.112137 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.112255 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.112446 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.112656 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.112860 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113015 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113152 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113295 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113430 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113570 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113707 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.113841 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114005 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114147 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114321 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114478 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114622 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114759 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.114928 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.115070 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.115245 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.115385 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.115554 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.115695 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.115889 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116108 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116248 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116382 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116538 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116679 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116828 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.116971 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.117107 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.117240 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.117375 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.117586 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.117724 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.117859 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118007 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118151 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118297 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118432 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118566 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118708 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118845 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.118979 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.119143 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.119284 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.119466 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.119675 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.119815 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.119979 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120114 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120259 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120406 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120543 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120678 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120812 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.120948 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.121088 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.121256 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.121399 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.121562 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.121704 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.121878 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122028 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122174 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122310 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122470 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122611 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122774 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.122924 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.123083 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.123224 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.123391 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.123532 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.123693 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.123877 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124041 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124193 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124352 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124492 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124657 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124809 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.124946 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.125080 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.125883 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126036 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126268 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126410 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126545 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126691 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126825 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.126959 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.127103 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.127240 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.127380 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.127515 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.127685 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.127848 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128023 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128171 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128315 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128451 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128621 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128762 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.128909 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.129045 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.129220 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.129368 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.129524 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.129690 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.129897 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130037 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130172 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130313 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130450 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130603 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130740 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.130874 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131008 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131142 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131275 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131423 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131584 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131725 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.131895 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132036 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132202 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132358 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132544 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132686 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132849 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.132989 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.133204 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.133346 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.133509 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.133651 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.133822 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.133962 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.134132 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.134274 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.134438 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.134590 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.134748 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.134888 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135060 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135202 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135363 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135510 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135674 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135842 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.135995 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.136130 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.136315 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.136426 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.136618 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.136709 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.136920 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137017 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137234 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137328 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137543 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137663 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137852 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.137942 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.138161 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.138249 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.138470 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.138576 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.138778 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.138866 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.139079 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.139166 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.139389 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.139484 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.139698 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.139791 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.140031 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.140126 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.140340 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.140435 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.140647 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.140733 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.141635 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.141821 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142067 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142225 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142319 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142537 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142622 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142849 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.142964 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.143156 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.143249 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.143467 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.143554 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.143778 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.143897 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.144107 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.144194 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.144431 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.144520 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.144743 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.144909 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145049 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145136 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145360 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145446 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145667 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145753 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.145978 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.146083 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.146281 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.146368 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.146612 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.146698 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.146930 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.147016 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.147258 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.147345 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.147587 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.147675 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.147917 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148007 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148230 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148317 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148543 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148630 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148858 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.148960 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.149164 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.149270 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.149475 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.149611 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.149790 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.149877 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.150103 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.150203 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.150418 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.150505 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.150733 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.150828 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151044 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151137 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151356 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151461 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151660 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151745 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.151994 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.152098 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.152299 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.152385 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.152601 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.152695 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.152918 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153005 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153223 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153309 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153529 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153621 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153845 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.153932 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.154152 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.154238 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.154466 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.154552 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.154775 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.154925 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.155207 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.155293 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.155529 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.155629 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.155867 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.155958 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.156187 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.156276 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.156546 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.156726 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.156869 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.156965 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.157188 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.157284 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.157510 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.157684 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.157818 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158009 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158235 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158322 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158552 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158647 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158865 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.158952 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.159181 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.159280 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.159489 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.159584 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.159797 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.159930 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.160135 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.160222 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.160464 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.160551 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.160771 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.160864 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.161080 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.161166 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.161388 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.161476 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.161714 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.161800 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162025 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162111 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162348 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162435 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162671 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162756 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.162982 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.163075 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.163286 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.163373 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.163589 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.163759 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.163934 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.164099 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.164240 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.164415 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.164552 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.164742 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.164861 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.165068 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.165163 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.165393 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.165504 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.165702 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.165790 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166025 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166112 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166339 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166427 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166657 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166742 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.166973 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.167059 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.167284 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.167371 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.167603 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.167689 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.167932 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168034 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168258 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168347 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168583 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168669 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168890 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.168987 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.169193 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.169280 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.169495 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.169613 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.169836 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.169931 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.170142 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.170229 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.170461 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.170547 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.170790 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.170886 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.171119 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.171206 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.171429 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.171515 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.171751 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.171861 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.172130 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.172216 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.172440 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.172710 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.172820 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173036 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173124 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173362 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173448 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173665 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173759 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.173968 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174063 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174274 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174359 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174578 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174672 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174882 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.174968 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.175184 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.175277 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.175495 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.175591 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.175804 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.175930 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.176131 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.176228 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.176436 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.176524 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.176756 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.176848 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177056 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177145 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177378 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177466 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177685 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177770 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.177987 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.178079 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.178291 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.178379 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.178594 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.178689 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.178929 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.179015 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.179232 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.179319 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.179562 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.179649 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.179911 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180014 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180228 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180315 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180553 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180638 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180862 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.180957 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.181185 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.181271 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.181500 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.181591 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.181815 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.181910 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.182121 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.182206 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.182431 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.182523 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.182744 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183008 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183110 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183191 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183345 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183429 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183651 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183740 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.183989 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.184089 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.184298 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.184384 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.184608 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.184695 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.184918 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.185130 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.185249 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.185461 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.185558 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.185781 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.185869 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.186095 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.186183 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.186410 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.186507 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.186726 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.186814 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.187041 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.187128 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.187354 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.187443 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.188238 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.188456 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.188583 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.188679 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.188908 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.189010 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.189236 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.189323 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.189558 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.189860 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.189963 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190034 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190227 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190350 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190549 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190709 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190873 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.190961 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.191196 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.191289 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.191517 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.191627 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.191910 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192094 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192202 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192336 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192485 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192647 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192801 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.192964 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.193122 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.193280 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.193440 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.193598 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.193761 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.193911 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.194224 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.194311 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.194539 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.194627 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.194853 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.194948 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.195164 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.195275 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.195475 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.195565 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.195791 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.195913 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.196132 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.196235 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.196464 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.196551 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.196777 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.196863 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.197095 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.197191 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.197407 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.197495 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.197722 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.197809 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.198039 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.198239 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.198366 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.198559 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.198704 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.198876 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.199025 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.199208 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.199344 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.199533 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.199662 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.199875 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.200016 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.200195 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.200377 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.200512 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.200696 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.200838 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201008 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201144 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201326 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201448 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201647 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201748 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.201967 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.202054 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.202283 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.202377 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.202604 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.202733 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.202921 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.203016 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.203259 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.204001 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.204172 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.204279 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.204491 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.204586 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.205067 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.205326 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.205423 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.205676 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.205764 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.205997 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.206092 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.206329 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.206424 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.206645 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.206737 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.206960 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.207047 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.207269 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.207373 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.207594 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.207791 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.207928 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.208135 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.208222 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.208472 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.208561 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.208803 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.208891 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.209133 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.209239 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.209438 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.209524 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.209752 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.209838 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210064 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210160 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210369 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210456 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210676 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210762 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.210981 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.211100 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.211298 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.211396 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.211600 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.211687 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.211938 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212043 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212243 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212332 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212551 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212643 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212854 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.212941 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.213156 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.213252 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.213460 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.213701 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.213797 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214054 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214142 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214353 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214446 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214663 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214766 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.214966 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.215054 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.215276 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.215364 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.215579 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.215676 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.215910 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.216015 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.216217 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.216303 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.216539 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.216617 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.216843 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217019 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217145 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217231 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217451 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217538 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217760 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.217849 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.218076 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.218162 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.218387 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.218475 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.218692 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.218778 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.219081 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.219170 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.219401 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.219519 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.219880 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.219971 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.220194 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.220340 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.220505 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.220665 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.220815 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221006 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221133 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221346 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221436 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221655 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221749 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.221962 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222049 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222268 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222364 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222592 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222681 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222905 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.222992 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.223216 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.223312 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.223525 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.223611 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.223878 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.223982 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.224161 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.224259 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.224472 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.224558 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.224786 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.224883 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.225094 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.225181 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.225404 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.225491 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.225712 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.225809 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226035 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226123 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226353 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226439 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226667 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226755 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.226983 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.227070 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.227297 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.227394 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.227604 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.227690 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.227933 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.228024 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.228243 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.228510 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.228680 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.228852 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.228940 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.229179 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.229269 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.229492 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.229589 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.229797 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.229884 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.230169 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.230254 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.230482 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.230579 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.230793 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.230925 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.231121 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.231208 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.231432 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.231531 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.231746 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.231881 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.232090 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.232195 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.232399 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.232486 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.232713 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.232800 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233020 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233115 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233336 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233430 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233654 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233748 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.233970 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.234070 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.234291 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.234378 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.234618 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.234834 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.234924 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.235232 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.235354 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.235555 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.235643 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.235901 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.236007 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.236229 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.236326 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.236543 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.236639 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.236856 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237006 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237164 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237263 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237474 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237561 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237783 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.237878 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.238104 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.238191 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.238422 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.238525 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.238734 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.238842 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.239038 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.239150 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.239367 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.239455 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.239676 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.239764 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.240012 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.240102 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.240324 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.240427 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.240729 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.240857 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.241055 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.241172 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.241372 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.241484 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.241694 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.241810 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.242009 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.242137 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.242340 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.242437 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.242678 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.242774 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243009 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243097 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243337 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243435 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243648 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243736 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.243982 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.244087 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.244295 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.244395 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.244611 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.244707 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.244924 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245010 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245234 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245331 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245543 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245630 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245857 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.245945 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.246171 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.246265 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.246501 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.246586 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.246819 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.246906 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.247140 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.247235 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.247463 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.247598 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.247783 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.247886 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.248120 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.248209 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.248454 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.248543 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.248769 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.248917 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249082 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249169 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249393 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249480 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249698 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249804 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.249939 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119026) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 16:38:09.250026 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.250863 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.251191 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.251520 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.251856 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.252180 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.252502 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.252825 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.253144 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.253458 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.253791 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.254106 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.254426 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.254744 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.255059 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.255378 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.255697 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.256060 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.256392 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.256721 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.257052 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.257401 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.257719 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.258067 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.258399 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.258718 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.259034 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.259343 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:38:09.259589 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=119025) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 16:38:09.273122 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_db.sqlalchemy.engines [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.282562 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.340370 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.context [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1490884b-e421-4bd9-b0b4-86739bfd9ed6(cell1) {{(pid=119026) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 16:38:09.344706 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_concurrency.lockutils [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:38:09.346284 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_concurrency.lockutils [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:38:09.347190 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_concurrency.lockutils [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:38:09.349164 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_concurrency.lockutils [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119026) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:38:09.350658 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.context [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1490884b-e421-4bd9-b0b4-86739bfd9ed6(cell1) {{(pid=119025) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 16:38:09.354859 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:38:09.356472 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:38:09.357290 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:38:09.359289 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:38:09.359600 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_db.sqlalchemy.engines [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.362021 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_db.sqlalchemy.engines [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.372960 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.374468 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.616284 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG oslo_db.sqlalchemy.engines [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119026) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.627793 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_db.sqlalchemy.engines [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=119025) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:38:09.958531 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: WARNING keystonemiddleware.auth_token [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:38:09.963043 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: WARNING keystonemiddleware.auth_token [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:38:09.965044 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: WARNING keystonemiddleware.auth_token [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:38:09.970135 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: WARNING keystonemiddleware.auth_token [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:38:10.187179 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: WARNING keystonemiddleware.auth_token [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:38:10.192977 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: WARNING keystonemiddleware.auth_token [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:38:10.193775 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: WARNING keystonemiddleware.auth_token [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:38:10.198319 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b04b09f9c0 pid: 119026 (default app) Nov 22 16:38:10.198885 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: WARNING keystonemiddleware.auth_token [None req-ff2dbb5b-a526-476d-a2e2-0ae382c3931b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:38:10.200308 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:38:10.201452 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001694 Nov 22 16:38:10.201860 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Mon Nov 22 16:38:10 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:38:10.205328 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b04b09f9c0 pid: 119025 (default app) Nov 22 16:39:30.584868 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:30.585860 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Nov 22 16:39:30.586318 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:31.148040 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-57638187-cc6e-4b35-a642-6e0b6ede918a admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:31.177498 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-57638187-cc6e-4b35-a642-6e0b6ede918a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.582424 Nov 22 16:39:31.179629 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Mon Nov 22 16:39:30 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:39:33.507689 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:33.509315 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-94d8cd81-e76e-42a8-89c2-28d7f7e57bbf None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Nov 22 16:39:33.512009 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:33 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:33.573379 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-9a07b5fc-8e11-4a46-a210-49d6e2cde9e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:33.594845 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:39:33.594845 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: warnings.warn(msg) Nov 22 16:39:33.627040 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-9a07b5fc-8e11-4a46-a210-49d6e2cde9e9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.109579 Nov 22 16:39:33.630157 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:33 2021] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:34.008736 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-cf910716-1b83-4ce9-bb6d-84a1e8262613 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:34.011019 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:39:34.011019 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: warnings.warn(msg) Nov 22 16:39:34.060573 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-cf910716-1b83-4ce9-bb6d-84a1e8262613 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.423473 Nov 22 16:39:34.061444 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Mon Nov 22 16:39:33 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:39:36.417391 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-9a07b5fc-8e11-4a46-a210-49d6e2cde9e9 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:36.419675 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-9a07b5fc-8e11-4a46-a210-49d6e2cde9e9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002067 Nov 22 16:39:36.425543 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:36 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:36.535237 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-78b23551-9c65-4d35-91ba-63a380ab0bab admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:36.553067 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:39:36.553067 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: warnings.warn(msg) Nov 22 16:39:36.573579 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-78b23551-9c65-4d35-91ba-63a380ab0bab admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146350 Nov 22 16:39:36.582324 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:36.587631 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-bd5ef991-3d09-4fab-8893-4a4ac9bc9ec4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:36.589125 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:39:36.589125 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: warnings.warn(msg) Nov 22 16:39:36.628916 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-bd5ef991-3d09-4fab-8893-4a4ac9bc9ec4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044706 Nov 22 16:39:36.629412 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Mon Nov 22 16:39:36 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:39:38.948813 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-78b23551-9c65-4d35-91ba-63a380ab0bab admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:38.951651 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-78b23551-9c65-4d35-91ba-63a380ab0bab admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003214 Nov 22 16:39:38.955863 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:38 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:39.011144 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-e62bd224-b003-448e-b8cc-baa86f6ff195 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:39.031080 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-e62bd224-b003-448e-b8cc-baa86f6ff195 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072145 Nov 22 16:39:39.031907 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:39.043949 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-5252d9e9-3a98-482b-902e-a3b6e1699c06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:39.068214 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-5252d9e9-3a98-482b-902e-a3b6e1699c06 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027900 Nov 22 16:39:39.068914 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Mon Nov 22 16:39:39 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:39:41.398905 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-e62bd224-b003-448e-b8cc-baa86f6ff195 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:41.399945 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-e62bd224-b003-448e-b8cc-baa86f6ff195 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Nov 22 16:39:41.400499 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:41.459612 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c7b6c01a-3810-4e0d-8cef-a13208d74c0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "vcpus": 2}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:41.478192 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c7b6c01a-3810-4e0d-8cef-a13208d74c0e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071038 Nov 22 16:39:41.478980 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:41.491842 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-50ee912b-360d-443d-8f91-dbcd5668aba2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:41.513326 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-50ee912b-360d-443d-8f91-dbcd5668aba2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025051 Nov 22 16:39:41.514048 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Mon Nov 22 16:39:41 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:39:43.847485 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c7b6c01a-3810-4e0d-8cef-a13208d74c0e admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:43.849330 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c7b6c01a-3810-4e0d-8cef-a13208d74c0e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Nov 22 16:39:43.849848 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:43.915640 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-6adcb865-b78f-4c8d-a957-aa802ca73e0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "name": "ds4G", "swap": 0}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:43.934242 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-6adcb865-b78f-4c8d-a957-aa802ca73e0e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076766 Nov 22 16:39:43.936065 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:43.948392 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-dfe1af30-f74d-4a5f-ad77-37a019b40c3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:43.972820 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-dfe1af30-f74d-4a5f-ad77-37a019b40c3d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027956 Nov 22 16:39:43.973603 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Mon Nov 22 16:39:43 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:39:46.404258 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-6adcb865-b78f-4c8d-a957-aa802ca73e0e admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:46.405262 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-6adcb865-b78f-4c8d-a957-aa802ca73e0e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Nov 22 16:39:46.405661 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:46.472142 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-ca5ba02e-a730-486f-ab17-1a19d7bd5c52 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:46.498717 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-ca5ba02e-a730-486f-ab17-1a19d7bd5c52 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.086480 Nov 22 16:39:46.499291 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Mon Nov 22 16:39:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:39:49.032563 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-6adcb865-b78f-4c8d-a957-aa802ca73e0e admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:49.033539 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-6adcb865-b78f-4c8d-a957-aa802ca73e0e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Nov 22 16:39:49.033945 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:49.094390 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-10cfca82-8cb1-4b1d-aae4-ac57e9363b91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:49.112887 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-10cfca82-8cb1-4b1d-aae4-ac57e9363b91 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072740 Nov 22 16:39:49.113608 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:49 2021] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:49.126400 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-0de06f32-901e-4856-9999-48678cee82df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:49.151067 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-0de06f32-901e-4856-9999-48678cee82df admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028960 Nov 22 16:39:49.151592 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Mon Nov 22 16:39:49 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:39:51.623050 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-10cfca82-8cb1-4b1d-aae4-ac57e9363b91 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:51.624077 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-10cfca82-8cb1-4b1d-aae4-ac57e9363b91 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001664 Nov 22 16:39:51.624488 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:51.683439 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-ab6def63-6a19-4a3f-94be-537a6a923636 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "2", "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:51.701993 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-ab6def63-6a19-4a3f-94be-537a6a923636 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071257 Nov 22 16:39:51.702643 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:51 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:51.714871 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-7a794571-6df6-4f20-85c2-86ce0cdb0417 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:51.737683 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-7a794571-6df6-4f20-85c2-86ce0cdb0417 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026362 Nov 22 16:39:51.738414 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Mon Nov 22 16:39:51 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:39:54.069048 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-ab6def63-6a19-4a3f-94be-537a6a923636 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:54.070076 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-ab6def63-6a19-4a3f-94be-537a6a923636 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Nov 22 16:39:54.070480 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:54.130677 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-0a6f2ec7-471a-4cec-a89f-ae0e2e9f397c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "id": "3"}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:54.150092 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-0a6f2ec7-471a-4cec-a89f-ae0e2e9f397c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072913 Nov 22 16:39:54.150671 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:54 2021] POST /compute/v2.1/flavors => generated 406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:54.164111 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-e61dad49-d298-4793-a7d1-67109da5ae4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:54.190052 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-e61dad49-d298-4793-a7d1-67109da5ae4c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029534 Nov 22 16:39:54.190645 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Mon Nov 22 16:39:54 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:39:56.543135 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-0a6f2ec7-471a-4cec-a89f-ae0e2e9f397c admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:56.544459 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-0a6f2ec7-471a-4cec-a89f-ae0e2e9f397c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Nov 22 16:39:56.544974 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:56.610349 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-0ef483a4-b248-4fc7-91a5-d6b4d9a26463 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large"}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:56.635346 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-0ef483a4-b248-4fc7-91a5-d6b4d9a26463 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083447 Nov 22 16:39:56.635933 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:39:56.648510 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-162a719a-7e3f-498a-acfc-cc2edfca5022 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:56.679953 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-162a719a-7e3f-498a-acfc-cc2edfca5022 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034930 Nov 22 16:39:56.680634 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Mon Nov 22 16:39:56 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:39:59.036522 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-0ef483a4-b248-4fc7-91a5-d6b4d9a26463 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:39:59.038234 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-0ef483a4-b248-4fc7-91a5-d6b4d9a26463 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Nov 22 16:39:59.038632 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:39:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:39:59.098681 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-efdbda88-50a5-4731-b6f3-f774f804e8c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:59.119407 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-efdbda88-50a5-4731-b6f3-f774f804e8c3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073932 Nov 22 16:39:59.120082 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Mon Nov 22 16:39:59 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:39:59.132382 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-9feacb58-6796-451f-bd75-a7db339bc37b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:39:59.157987 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-9feacb58-6796-451f-bd75-a7db339bc37b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029162 Nov 22 16:39:59.158594 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Mon Nov 22 16:39:59 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:40:20.533934 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-efdbda88-50a5-4731-b6f3-f774f804e8c3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:20.534968 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-efdbda88-50a5-4731-b6f3-f774f804e8c3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Nov 22 16:40:20.535367 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:40:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:20.595808 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-1e8ffa2e-ab22-4b4c-a067-8054bb160e85 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:20.613843 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-1e8ffa2e-ab22-4b4c-a067-8054bb160e85 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072133 Nov 22 16:40:20.614367 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Mon Nov 22 16:40:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:40:22.095502 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-efdbda88-50a5-4731-b6f3-f774f804e8c3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:22.096523 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-efdbda88-50a5-4731-b6f3-f774f804e8c3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Nov 22 16:40:22.096921 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:22.285003 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-eee44df0-10fd-4cda-8143-f87b3072d167 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:22.290448 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.wsgi [None req-eee44df0-10fd-4cda-8143-f87b3072d167 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 16:40:22.290988 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-eee44df0-10fd-4cda-8143-f87b3072d167 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=119025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:40:22.291788 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-eee44df0-10fd-4cda-8143-f87b3072d167 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057443 Nov 22 16:40:22.292314 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Nov 22 16:40:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 16:40:22.302181 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-258eff12-8b6a-406f-adc8-6d78d326e0d7 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:22.322332 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-258eff12-8b6a-406f-adc8-6d78d326e0d7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023570 Nov 22 16:40:22.322851 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Nov 22 16:40:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:40:22.333761 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-a692e45f-6ee5-48e5-8cdc-635c797c01ea admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:22.354673 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-a692e45f-6ee5-48e5-8cdc-635c797c01ea admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024578 Nov 22 16:40:22.355194 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Nov 22 16:40:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:40:22.364922 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-47d19bc3-3389-4aaa-a364-68b83eb78cd6 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:22.370200 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.wsgi [None req-47d19bc3-3389-4aaa-a364-68b83eb78cd6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 16:40:22.370752 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-47d19bc3-3389-4aaa-a364-68b83eb78cd6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=119026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:40:22.371523 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-47d19bc3-3389-4aaa-a364-68b83eb78cd6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010077 Nov 22 16:40:22.372029 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Nov 22 16:40:22 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 16:40:23.763689 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-a692e45f-6ee5-48e5-8cdc-635c797c01ea admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:23.764788 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-a692e45f-6ee5-48e5-8cdc-635c797c01ea admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002102 Nov 22 16:40:23.765220 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:23.958676 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-1ea62f10-c142-4114-a559-388a8fb6e0f9 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:23.964282 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.wsgi [None req-1ea62f10-c142-4114-a559-388a8fb6e0f9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 16:40:23.964840 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-1ea62f10-c142-4114-a559-388a8fb6e0f9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=119026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:40:23.965632 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-1ea62f10-c142-4114-a559-388a8fb6e0f9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058348 Nov 22 16:40:23.966955 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Nov 22 16:40:23 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 16:40:23.976603 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-bc0a3420-522d-4a2f-9779-a9a96ce6fc37 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:23.989530 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-bc0a3420-522d-4a2f-9779-a9a96ce6fc37 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016472 Nov 22 16:40:23.990040 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Nov 22 16:40:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:40:23.999800 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-b0577d7b-c04f-469c-b3ce-b18ce9b5f482 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:24.013607 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-b0577d7b-c04f-469c-b3ce-b18ce9b5f482 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016739 Nov 22 16:40:24.014250 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Nov 22 16:40:23 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:40:24.023653 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-a9e4ffc5-6e5e-47e2-9672-ce2c9c8181be admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:24.029546 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.wsgi [None req-a9e4ffc5-6e5e-47e2-9672-ce2c9c8181be admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 16:40:24.030158 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-a9e4ffc5-6e5e-47e2-9672-ce2c9c8181be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=119025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:40:24.030929 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-a9e4ffc5-6e5e-47e2-9672-ce2c9c8181be admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010732 Nov 22 16:40:24.031410 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Mon Nov 22 16:40:24 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 16:40:25.401068 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-b0577d7b-c04f-469c-b3ce-b18ce9b5f482 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:25.402071 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-b0577d7b-c04f-469c-b3ce-b18ce9b5f482 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Nov 22 16:40:25.402467 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:25.594685 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-0fee803f-a25e-4f71-85b6-9a426e05b5e8 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:25.599795 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.wsgi [None req-0fee803f-a25e-4f71-85b6-9a426e05b5e8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 16:40:25.600377 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-0fee803f-a25e-4f71-85b6-9a426e05b5e8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=119025) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:40:25.601155 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-0fee803f-a25e-4f71-85b6-9a426e05b5e8 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059690 Nov 22 16:40:25.601655 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Nov 22 16:40:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 16:40:25.611426 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-6e5039b2-a2a0-4cc4-b620-ca9c5339c8be admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:25.625096 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-6e5039b2-a2a0-4cc4-b620-ca9c5339c8be admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017156 Nov 22 16:40:25.625608 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Nov 22 16:40:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:40:25.635752 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:25.649224 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017285 Nov 22 16:40:25.649750 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Mon Nov 22 16:40:25 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:40:25.659812 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-a1386846-3c99-474f-a429-3c0cea23bfa3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:25.664916 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.wsgi [None req-a1386846-3c99-474f-a429-3c0cea23bfa3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 16:40:25.665471 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-a1386846-3c99-474f-a429-3c0cea23bfa3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=119026) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:40:25.666241 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-a1386846-3c99-474f-a429-3c0cea23bfa3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009826 Nov 22 16:40:25.666718 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Nov 22 16:40:25 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 16:40:27.054868 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:27.055933 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 22 16:40:27.056329 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:27.253970 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-72dd16bf-1e96-42ba-bf9a-aeb0d317ff2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:40:27.271877 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-72dd16bf-1e96-42ba-bf9a-aeb0d317ff2e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069970 Nov 22 16:40:27.272402 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Nov 22 16:40:27 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:40:28.674131 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:28.675132 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Nov 22 16:40:28.675535 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:28.871757 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-0ae63143-93c1-4f9e-ba71-8cba674b26ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:40:28.889595 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-0ae63143-93c1-4f9e-ba71-8cba674b26ca admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069637 Nov 22 16:40:28.890068 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Nov 22 16:40:28 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:40:30.313674 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:30.314765 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 22 16:40:30.315159 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:30.506203 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-519ac014-35c7-4d2e-91e4-b0397284ea60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:40:30.525297 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-519ac014-35c7-4d2e-91e4-b0397284ea60 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070990 Nov 22 16:40:30.525774 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Nov 22 16:40:30 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:40:31.907728 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:31.908755 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Nov 22 16:40:31.909154 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:32.099043 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-d5743810-09a0-4cfe-a181-b67f2004740e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:40:32.117769 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-d5743810-09a0-4cfe-a181-b67f2004740e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069728 Nov 22 16:40:32.118461 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Mon Nov 22 16:40:32 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:40:33.503304 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:33.504346 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Nov 22 16:40:33.504750 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:40:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:40:33.698339 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-ce7fd16f-b94f-46b3-bdc6-744c3bc58051 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:40:33.717496 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-ce7fd16f-b94f-46b3-bdc6-744c3bc58051 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070647 Nov 22 16:40:33.717947 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Mon Nov 22 16:40:33 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:41:20.282911 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:41:20.283949 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-c0953c16-1c66-4998-b75f-134bc2c09637 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 22 16:41:20.284356 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Mon Nov 22 16:41:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:41:20.343468 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-55f265bc-5e87-4d38-8b0e-afec725f96bb admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:41:20.363257 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-55f265bc-5e87-4d38-8b0e-afec725f96bb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072495 Nov 22 16:41:20.363805 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Mon Nov 22 16:41:20 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:41:20.386357 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-7073177c-e8d1-41e3-959d-e0d0e4798fbe admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:41:20.394077 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-7073177c-e8d1-41e3-959d-e0d0e4798fbe admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011277 Nov 22 16:41:20.394591 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Mon Nov 22 16:41:20 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:41:20.406727 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-fef21da7-997e-4c67-801d-1c591a00605e admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:41:20.414340 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-fef21da7-997e-4c67-801d-1c591a00605e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011661 Nov 22 16:41:20.414852 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Mon Nov 22 16:41:20 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:41:20.426840 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-b6cb7eed-cb1a-4395-a510-95263f7c2f24 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:41:20.434433 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-b6cb7eed-cb1a-4395-a510-95263f7c2f24 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011081 Nov 22 16:41:20.435086 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Mon Nov 22 16:41:20 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:41:20.446547 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:41:20.454168 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011042 Nov 22 16:41:20.454675 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Mon Nov 22 16:41:20 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:42:42.909262 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-34a058b9-30f1-4354-a0fa-100cdeb89bf5 tempest-verify_tempest_config-660847484 tempest-verify_tempest_config-660847484-project] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:42:42.911233 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-34a058b9-30f1-4354-a0fa-100cdeb89bf5 tempest-verify_tempest_config-660847484 tempest-verify_tempest_config-660847484-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.106052 Nov 22 16:42:42.911758 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 34/69] 10.222.0.61 () {58 vars in 1133 bytes} [Mon Nov 22 16:42:42 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:44:14.945512 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:14.946665 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Nov 22 16:44:14.947068 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 36/70] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:44:14 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:44:15.219038 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-119b7200-931b-4dc5-a5fd-0c8c2179e8d2 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:15.220223 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:44:15.220223 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: warnings.warn(msg) Nov 22 16:44:15.221754 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-119b7200-931b-4dc5-a5fd-0c8c2179e8d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:15.222212 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-119b7200-931b-4dc5-a5fd-0c8c2179e8d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:15.222992 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-119b7200-931b-4dc5-a5fd-0c8c2179e8d2 admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:15.223411 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-119b7200-931b-4dc5-a5fd-0c8c2179e8d2 admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:15.261360 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-119b7200-931b-4dc5-a5fd-0c8c2179e8d2 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.170729 Nov 22 16:44:15.261910 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 35/71] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Nov 22 16:44:15 2021] GET /compute/v2.1/os-services => generated 794 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:44:16.726854 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:16.728084 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001719 Nov 22 16:44:16.728491 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 37/72] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:44:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:44:16.927226 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-9fe4911e-4f70-47e1-9f04-f76e48e3a9c8 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:16.928427 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:44:16.928427 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: warnings.warn(msg) Nov 22 16:44:16.929988 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-9fe4911e-4f70-47e1-9f04-f76e48e3a9c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:16.930367 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-9fe4911e-4f70-47e1-9f04-f76e48e3a9c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:16.931177 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-9fe4911e-4f70-47e1-9f04-f76e48e3a9c8 admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:16.931593 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-9fe4911e-4f70-47e1-9f04-f76e48e3a9c8 admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:16.951150 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-9fe4911e-4f70-47e1-9f04-f76e48e3a9c8 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077752 Nov 22 16:44:16.951721 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 36/73] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Nov 22 16:44:16 2021] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:44:28.784317 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:28.785877 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002872 Nov 22 16:44:28.786276 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 38/74] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:44:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:44:28.981205 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-049dd01d-e0b4-4d20-8b02-91cc7f61d75a admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:28.982372 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:44:28.982372 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: warnings.warn(msg) Nov 22 16:44:28.983915 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-049dd01d-e0b4-4d20-8b02-91cc7f61d75a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:28.984363 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-049dd01d-e0b4-4d20-8b02-91cc7f61d75a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:28.985160 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-049dd01d-e0b4-4d20-8b02-91cc7f61d75a admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:28.985614 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-049dd01d-e0b4-4d20-8b02-91cc7f61d75a admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:29.010236 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-049dd01d-e0b4-4d20-8b02-91cc7f61d75a admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082086 Nov 22 16:44:29.010733 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 37/75] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Nov 22 16:44:28 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:44:30.411192 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: DEBUG nova.api.openstack.wsgi [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] Calling method '>' {{(pid=119026) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:30.412281 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: INFO nova.api.openstack.requestlog [None req-c0f95cb6-04d9-4ecf-88ad-7811486bcac3 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 22 16:44:30.412683 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: [pid: 119026|app: 0|req: 39/76] 10.222.0.61 () {56 vars in 1074 bytes} [Mon Nov 22 16:44:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:44:30.603723 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG nova.api.openstack.wsgi [None req-52396d57-bbcc-41c0-bac5-1b639588d565 admin admin] Calling method '>' {{(pid=119025) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:44:30.604914 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:44:30.604914 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: warnings.warn(msg) Nov 22 16:44:30.607209 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-52396d57-bbcc-41c0-bac5-1b639588d565 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:30.607642 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-52396d57-bbcc-41c0-bac5-1b639588d565 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:30.608481 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-52396d57-bbcc-41c0-bac5-1b639588d565 admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:44:30.608911 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: DEBUG oslo_concurrency.lockutils [None req-52396d57-bbcc-41c0-bac5-1b639588d565 admin admin] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=119025) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:44:30.631273 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: INFO nova.api.openstack.requestlog [None req-52396d57-bbcc-41c0-bac5-1b639588d565 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078373 Nov 22 16:44:30.631851 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: [pid: 119025|app: 0|req: 38/77] 10.222.0.61 () {60 vars in 1193 bytes} [Mon Nov 22 16:44:30 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:45:28.672832 dv-cinder-804735-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 22 16:45:28.673386 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: Mon Nov 22 16:45:28 2021 - graceful shutdown triggered... Nov 22 16:45:28.673815 dv-cinder-804735-12-iscsi devstack@n-api.service[119025]: Gracefully killing worker 1 (pid: 119025)... Nov 22 16:45:28.674822 dv-cinder-804735-12-iscsi devstack@n-api.service[119026]: Gracefully killing worker 2 (pid: 119026)... Nov 22 16:45:29.674539 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: worker 1 buried after 1 seconds Nov 22 16:45:29.674539 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: worker 2 buried after 1 seconds Nov 22 16:45:29.674539 dv-cinder-804735-12-iscsi devstack@n-api.service[119024]: goodbye to uWSGI. Nov 22 16:45:29.676136 dv-cinder-804735-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 22 16:45:29.676685 dv-cinder-804735-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 22 16:45:29.679419 dv-cinder-804735-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 16:45:29.690611 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 16:45:29 2021] *** Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: nodename: dv-cinder-804735-12-iscsi Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: machine: x86_64 Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: clock source: unix Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: pcre jit disabled Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: detected number of CPU cores: 4 Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: current working directory: / Nov 22 16:45:29.692797 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: detected binary path: /usr/bin/uwsgi-core Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: your processes number limit is 47680 Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: your memory page size is 4096 bytes Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: detected max file descriptor number: 2048 Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: lock engine: pthread robust mutexes Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: thunder lock: enabled Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 16:45:29.693600 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 16:45:29.742401 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: Python main interpreter initialized at 0x556d0bf999c0 Nov 22 16:45:29.742401 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: python threads support enabled Nov 22 16:45:29.742401 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: your server socket listen backlog is limited to 100 connections Nov 22 16:45:29.742401 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: your mercy for graceful operations on workers is 90 seconds Nov 22 16:45:29.742845 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 16:45:29.742845 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: *** Operational MODE: preforking *** Nov 22 16:45:29.743142 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: *** uWSGI is running in multiple interpreter mode *** Nov 22 16:45:29.743142 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: spawned uWSGI master process (pid: 133201) Nov 22 16:45:29.743344 dv-cinder-804735-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 16:45:29.744158 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: spawned uWSGI worker 1 (pid: 133215, cores: 1) Nov 22 16:45:29.745196 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: spawned uWSGI worker 2 (pid: 133216, cores: 1) Nov 22 16:45:29.745506 dv-cinder-804735-12-iscsi devstack@n-api.service[133201]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 16:45:31.614160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:45:31.614160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: from cryptography.utils import int_from_bytes Nov 22 16:45:31.614923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:45:31.614923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: from cryptography.utils import int_from_bytes Nov 22 16:45:31.626014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:45:31.626014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: from cryptography.utils import int_from_bytes Nov 22 16:45:31.626731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 16:45:31.626731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: from cryptography.utils import int_from_bytes Nov 22 16:45:34.052166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 16:45:34.052849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 16:45:34.052950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 16:45:34.053304 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 16:45:34.053565 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 16:45:34.053967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.054294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.054619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.054952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.055281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.055597 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.055952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.056287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.056670 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.056937 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.057266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.057605 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-12-iscsi {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.057928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.058281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.058608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.059037 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.059476 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.059871 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.060179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.060710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.062380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.062380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.062380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.062707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.062957 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.063211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.063532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.063866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.064219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.064535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.064943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-12-iscsi {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.065353 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.065717 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.066136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.066572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.066888 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.067219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.067536 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.067907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.068225 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.068576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.068884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.069217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.069567 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.069990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.070367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.070755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.071091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.071408 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.071719 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.072048 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.072677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.073340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.074568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.074992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.075412 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.075893 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.076273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.076870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.077040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.077247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.077566 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.077884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.078292 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.078613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.078929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.079245 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.079583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.080153 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.080316 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.080570 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.080898 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.081320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.081652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.081884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.082231 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.082733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.082968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.083293 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.083631 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.083964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.084277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.084589 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.085044 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.085391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.085820 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.086087 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.086396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.086786 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.087150 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.087726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.088137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.088479 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.088850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.089345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.089726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.090780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.091136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.091443 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.091764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.092114 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.092431 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.092738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.093302 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.094027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.094768 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.095073 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.095233 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 16:45:34.095725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 16:45:34.095873 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.096182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 16:45:34.096302 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.096404 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 16:45:34.096620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 16:45:34.096732 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.097049 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.097237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.097451 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.097788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.097894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.098106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.098361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.098512 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.098743 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.098918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.099128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.099263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.099465 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.099645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.099867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.100016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.100123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.100343 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.100506 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.100696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.100837 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-12-iscsi {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.101310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.101465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.101642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.101790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.101901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.101975 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102238 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102572 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102720 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.102989 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.103325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.103430 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.103715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104024 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104206 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104378 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104455 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.104801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.105005 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.105146 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.105333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.105608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.105722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.106370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.106531 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.106630 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.106731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.106851 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.107155 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.107273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.107651 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.107775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.108155 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.108314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-12-iscsi {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.108479 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.108580 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.108802 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.108900 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.109127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.109232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.109464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.109566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.109861 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.110007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.110187 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.110332 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.110513 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.110654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.110848 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.111004 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.111169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.111776 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.111986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.111986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.112290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.112811 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.112912 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.113004 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.113004 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.113144 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.113224 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.113411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.113496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.113748 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.114011 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.114100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.114362 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.114506 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.114645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.114931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.115043 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.115252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.115408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.115644 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.115796 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.116047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.116246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.116369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.116717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.116802 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.116887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.116970 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.117295 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.117438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.117540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.117804 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.117895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.118162 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.118327 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.118487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.118825 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.119148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.119563 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.119661 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.119991 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.120613 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.120727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.120826 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.121132 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.121229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.121505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.122047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.122156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.122298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.122446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.122602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.122785 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.123081 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.123303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.123452 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.123672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.123881 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.124125 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.124276 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.124437 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.124599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.124864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.125057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.125222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.125382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.125739 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.125896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.126040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.126182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.126351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.126509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.127000 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.127155 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.127291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.127480 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.127627 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.127795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.128239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.128402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.128546 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.128704 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.128865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.128986 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.129072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.129153 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.129235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.129490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.129580 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.129878 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.130336 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.130609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.130722 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.130878 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.130991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.130991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.131182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.131291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.131616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.131786 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.132459 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.132609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.132749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.132749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.133019 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.133156 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.133234 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.133303 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.133487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.133601 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.133801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.133973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.134119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.134438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.134563 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.134777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.135113 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.135203 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.135435 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.135721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.136080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.136080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.137201 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.137325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.137325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.137475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.137575 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.137899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.138046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.138313 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.138541 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.138691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.138859 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.139149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.139309 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.139492 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.139751 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.139951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.140156 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.140366 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.140514 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.140774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.140956 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.141107 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.141408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.141550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.141711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.142027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.142523 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.142667 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.142667 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.142938 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.143086 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.143234 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.143384 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.143536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.143784 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.144036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.144173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.144361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.144515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.144814 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.144964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.145165 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.145442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.145586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.145777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 16:45:34.146056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.146426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.146572 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.146707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.146978 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.147427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.147605 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.147805 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.147988 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.148139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.148412 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.148560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.148898 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.149065 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.149203 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.149422 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.149612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.149775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.150053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.150191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.150377 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.150750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.150903 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.151153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.151389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.151524 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.151953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.152176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.153234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.153234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.153590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.153743 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.154085 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.154318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.154318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.154625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.154774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.154774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.155133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.155295 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.155564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.155728 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.155728 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.156025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.156162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.156397 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.156701 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.156843 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.156977 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.157112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.157405 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.157699 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.157805 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.158040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.158209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.158461 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.158793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.158946 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.159079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.159345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.159553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.159699 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.159926 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.160130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.161318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.161636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.161845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.161845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.162143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.162291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.162291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.162838 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.162998 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.162998 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.163273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.163529 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.163529 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.163841 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.163980 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.164247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.164443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.164596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.164746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.164746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.165026 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.165120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.165120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.165424 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.165583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.165752 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.166075 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.166197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.166416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.166900 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.167017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.168204 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.168548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.168715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169451 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.169941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.170184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.170360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.170679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.170836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.171059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.171395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.171542 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.171841 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.172030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.172230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.173642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.173845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.174015 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.174185 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.174501 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.174501 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.174792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.174935 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.175123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.175340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.175496 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.175958 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.176135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.176358 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.176358 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.176778 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.176778 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.177601 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.177768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.177768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178542 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.178981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.179062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.179138 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.179138 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.179302 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.179514 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.179896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.180043 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.180223 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.180460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.180557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.180849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.181043 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.181211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.181534 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.181625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.181893 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.182224 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.182314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.182563 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.182852 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.182965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.183211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.183462 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.183607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.183881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.184121 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.184238 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.184523 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.184793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.185421 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.185865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.186092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.186439 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.186669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.186887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.187134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.187364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.187654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.187953 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.188097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.188097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.188362 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.188553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.188704 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.188865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.189057 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.189318 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.189475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.189723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.190065 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.190395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.190723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.190917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.191084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.191355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.191514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.191667 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.192017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.192188 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.192333 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.192670 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.192835 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.192994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.193277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.193377 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.193649 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.193876 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.194046 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.194356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.194476 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.194707 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.194812 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.194993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.195164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.195264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.195469 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.195582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.195806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196004 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196159 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196250 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196490 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196579 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196818 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.196974 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.197149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.197304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.197459 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.197616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.197791 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.197970 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.198117 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.198273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.198432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.198603 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.198774 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.198925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.199075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.199395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.199496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.199744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.199902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.200065 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.200339 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.200439 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.200679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.200773 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201001 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201101 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201415 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.201967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.202058 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.202288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.202378 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.202622 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.202725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.202941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.203030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.203251 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.203348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.203638 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.203741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.203886 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.204208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.204314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.204409 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.204498 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.204580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.204872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205000 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205477 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205621 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205797 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.205963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.206110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.206256 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.206421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.206598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.206822 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.206934 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.207136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.207259 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.207459 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.207594 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.207768 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.207945 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.208126 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.208271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.208438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.208612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.208766 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.208944 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.209128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.209266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.209533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.209629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.209755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.209898 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.210064 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.210225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.210414 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.210545 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.210723 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.210881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.211070 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.211202 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.211405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.211527 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.211750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.211865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.212111 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.212205 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.212684 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.212794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.213050 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.213139 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.213366 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.213657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.213744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.213969 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.214061 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.215029 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.215130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.215228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.215308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.215540 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217079 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217282 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217646 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217831 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.217995 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218067 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218159 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218495 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218729 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.218888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219042 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219321 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.219858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.220146 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.220249 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.220479 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.220561 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.220801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.220905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.221178 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.221325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.221502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.221613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.221817 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.221931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.222135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.222233 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.222444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.222543 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.222754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.222867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.223087 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.223194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.223409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.223512 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.223715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.223975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.224088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.224175 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.224376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.224473 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.231280 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.231538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.231538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.231801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.231978 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232074 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232272 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232357 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232521 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232784 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.232955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233044 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233142 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233227 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233397 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233659 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233833 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.233924 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234277 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234373 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234457 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234541 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234713 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234805 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.234895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235683 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235889 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.235960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236045 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236140 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236666 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.236927 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237270 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237374 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237559 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237734 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237823 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.237989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.239677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.240386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.240489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.240583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.240675 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.243564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.243564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244010 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244112 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244617 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244763 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244839 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.244917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245082 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245159 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245379 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245736 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245816 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245886 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.245968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246047 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246206 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246285 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246366 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.246968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247044 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247121 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247201 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247279 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247505 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247573 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247653 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247808 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247901 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.247969 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248133 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248357 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248876 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.248955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.249031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.249101 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.249168 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.249234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.249909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250026 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250180 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250248 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250324 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250734 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.250827 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.251138 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.251242 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.251329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.251407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252668 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252833 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252910 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.252980 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253493 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.253907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.254153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.254253 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.254490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.254571 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.254815 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.254906 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.255142 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.255229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.255467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.255566 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.255793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.255939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.256141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.256233 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.256466 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.256554 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.256775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.256878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.257090 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.257181 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.257399 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.257489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.257714 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.257807 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258037 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258133 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258672 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.258980 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.259068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.259291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.259379 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.259624 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.259847 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.259988 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.260137 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.260269 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.260476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.260675 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.260800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.261002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.261188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.261352 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.261483 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.261683 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.261957 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262049 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262910 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.262997 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.263217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.263301 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.263527 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.263657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.263907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264185 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264816 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.264959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.265128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.265274 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.265434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.265598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.265740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.265934 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.266064 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.266251 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.266374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.266566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.266698 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.266883 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.267017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.267216 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.267341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.267533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.267666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.267894 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.268000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.268315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.268417 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.268629 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.268715 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.268935 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.269025 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.269240 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.269414 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.269546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.269643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.269892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270004 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270628 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270817 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.270917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.271148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.271239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.271461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.271575 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.271794 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.271994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.272163 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.272256 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.272474 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.272577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.272793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.272892 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.273112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.273203 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.273414 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.273516 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.273726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.273918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274186 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274338 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274848 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.274984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.275120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.275273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.275446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.275642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.275790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.277604 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.277773 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.277773 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.278187 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.278352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.278352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.278612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.278763 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.278920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.279074 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.279074 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.282964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.282964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.283282 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.283428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.283582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.283582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.283920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284065 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284656 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.284796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285101 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285490 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285625 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.285909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.286192 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.286330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.286330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.286692 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.286841 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.286841 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.287088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.287223 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.287223 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.287496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.287645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.287954 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.288109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.288109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.288377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.288551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.288551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.288839 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289006 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289157 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289306 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289306 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289605 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289756 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.289756 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290066 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290497 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290631 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290820 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.290965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.291294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.291454 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.291454 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.291734 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.293631 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.293631 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.293992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.294147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.294147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.294147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.294577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.294737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.294737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.295019 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.295232 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.295389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.295561 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.295561 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.295865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296480 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296480 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.296899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297684 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297684 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.297991 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.298150 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.298322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.298468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.298468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.298741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.298891 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.299141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.299300 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.299448 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.299686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.300379 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.300379 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.300696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.300847 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.300847 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.301165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.301317 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.301466 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.301639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.301918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.302083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.302236 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.302472 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.302655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.302853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.303031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.303184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.303495 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.303679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.303887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.304161 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.304298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.304493 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.304671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.304846 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.305089 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.305271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.305439 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.305651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.305828 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.306104 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.306275 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.306429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.306692 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.306866 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.307125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.307299 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.307460 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.307730 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.308304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.308304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.308756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.308922 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.308922 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.309230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.309393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.309393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.309710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.309883 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.310045 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.310196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.310349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.310587 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.310762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.310953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.311170 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.311342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.311591 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.311773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.311975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.312266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.312426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.312614 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.312827 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.313011 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.313259 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.313411 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.313577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.313879 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.314067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.314432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.314691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.314805 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.315027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.315126 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.315379 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.315478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.315722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.315852 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.316093 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.316190 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.316424 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.316555 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.316755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.316897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.317071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.317172 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.317389 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.317494 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.317711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.317805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318035 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318151 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318455 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.318994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.319096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.319311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.319411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.320242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.320369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.320461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.320550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.320625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.320814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.321178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.321432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.321527 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.321811 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.321896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.322142 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.322223 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.322468 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.322560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.322782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.322876 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.323113 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.323204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.323510 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.323685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.323763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324377 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324595 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324756 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324838 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324922 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.324995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.325241 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.325338 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.325610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.325700 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.325952 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.326055 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.326281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.326390 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.326607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.326700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.326926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.327020 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.327244 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.327346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.327557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.327649 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.327890 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.328044 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.328214 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.328376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.328526 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329547 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.329925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.330243 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.330564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.330888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.331208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.331409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.331559 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.331779 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.332295 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.332412 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.332685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.333052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.333411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.333797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.334118 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.334519 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.334640 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.334867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.335022 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.335183 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.335719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.336378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.336959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.337890 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.338515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.340214 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.340327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.340867 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.340984 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.341606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.342294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.342967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.343235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.343664 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.344370 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.344489 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.344792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.344967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.345438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.345638 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.345876 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.346038 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.346195 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.346567 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.346720 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.346924 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.347176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.347272 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.347974 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.348127 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.348279 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.348279 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.348577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.348726 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.348918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.349051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.349287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.349541 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.349712 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.349939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.350110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.350274 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.350592 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.350918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.351085 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.351240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.351621 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.351724 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.352064 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.352370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.352550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.352735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.353040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.353179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.353611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.353714 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.353892 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.354193 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.354357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.354624 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.355672 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.355882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.356012 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.356165 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.356364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.356519 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.356709 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.357053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.357222 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.357423 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.357862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.358220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.358576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.358850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.358983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.359244 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.359565 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.360765 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.360765 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.361328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.361500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.361500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.361830 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.361981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.362197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.362440 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.362440 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.362738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.362896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.363055 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.363421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.364027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.364172 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.364423 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.364595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.364789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.365136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.365491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.365835 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.366192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.366504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.366625 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.366844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.367104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.367241 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.367495 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.367762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.367944 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.368368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.368487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.368750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.368940 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.369121 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.369507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.369688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.369977 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.370112 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.370411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.370646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.370831 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.371003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.371416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.371864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.372268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.372502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.372674 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.375856 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.375856 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.376796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377024 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377143 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377143 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.377917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.378197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.378545 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.378864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.379118 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 16:45:34.379493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.380117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.380684 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.381223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.382010 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.382349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.382901 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.383866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.385356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.385356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.385356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.385821 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.386728 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.387537 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.388104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.388638 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.389179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.389763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.390329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.391179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.391756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.393360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.394229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.394229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.395870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.395870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.395870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.396323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.397119 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.397896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.398688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.399461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.400253 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.401003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.402304 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.403191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.404327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.405120 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.406612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.407432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.408271 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.409130 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.409911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.410720 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.411491 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.412290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.413918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.414739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.415338 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_db.sqlalchemy.engines [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.415783 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.416729 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.418199 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.419335 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.420403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.421563 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.422420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.422965 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.423550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.424132 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.424663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.425211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.425738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 16:45:34.426165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=133216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 16:45:34.465566 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_db.sqlalchemy.engines [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.596761 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.context [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1490884b-e421-4bd9-b0b4-86739bfd9ed6(cell1) {{(pid=133215) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 16:45:34.601705 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:45:34.603434 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:45:34.604443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:45:34.607313 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:45:34.619028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_db.sqlalchemy.engines [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.625081 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_db.sqlalchemy.engines [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.651014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.context [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1490884b-e421-4bd9-b0b4-86739bfd9ed6(cell1) {{(pid=133216) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 16:45:34.656222 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:45:34.657876 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:45:34.658753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:45:34.660826 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:45:34.673283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_db.sqlalchemy.engines [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.675375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_db.sqlalchemy.engines [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.798006 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_db.sqlalchemy.engines [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:34.847616 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_db.sqlalchemy.engines [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 16:45:35.186649 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: WARNING keystonemiddleware.auth_token [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:45:35.193529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: WARNING keystonemiddleware.auth_token [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:45:35.228044 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: WARNING keystonemiddleware.auth_token [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:45:35.235244 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: WARNING keystonemiddleware.auth_token [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:45:35.567196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: WARNING keystonemiddleware.auth_token [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:45:35.572777 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: WARNING keystonemiddleware.auth_token [None req-839a09ab-4ca7-482e-b00a-7629d75e9935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:45:35.579015 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d0bf999c0 pid: 133216 (default app) Nov 22 16:45:35.596491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: WARNING keystonemiddleware.auth_token [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 16:45:35.602253 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: WARNING keystonemiddleware.auth_token [None req-4d2712ed-def5-4167-8af4-8eb8545c3030 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 16:45:35.607853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d0bf999c0 pid: 133215 (default app) Nov 22 16:46:15.409223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1c5eb67e-b6d4-4756-a590-bd0469f88654 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Action: 'create', calling method: .version_select at 0x7fc6971614c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2001812547"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:15.570431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1874051924", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "45736139-c6d0-4dea-bd82-3ebc3b844a1c"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:17.029995 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] validate_networks() for [('45736139-c6d0-4dea-bd82-3ebc3b844a1c', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:46:17.688586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1c5eb67e-b6d4-4756-a590-bd0469f88654 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.337193 Nov 22 16:46:17.690903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1154 bytes} [Mon Nov 22 16:46:13 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 4344 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 16:46:18.394790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-48560346-ec1c-48f6-b370-21b54112e606 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Action: 'create', calling method: .version_select at 0x7fc6971340d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-16627859", "metadata": {"Type": "work"}}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:18.397531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-48560346-ec1c-48f6-b370-21b54112e606 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:18.398629 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-48560346-ec1c-48f6-b370-21b54112e606 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.699721 Nov 22 16:46:18.399805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1155 bytes} [Mon Nov 22 16:46:17 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 708 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 16:46:18.687620 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-557247182", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "efc621b2-0d87-49ac-81d5-2c5c14e1884c"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:18.861258 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] validate_networks() for [('efc621b2-0d87-49ac-81d5-2c5c14e1884c', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:46:18.908626 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:46:18.909257 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:46:18.909547 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:46:18.910237 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:46:18.910829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:46:18.944841 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:18.945297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:18.946114 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:18.946548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:19.022002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:19.032633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for user d7fd3afd3c5c48998728927ac2874231 and project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:19.100794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:46:19.120746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:46:19.426382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-357909db-a922-4c95-84c2-bcca79cb3445 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.810161 Nov 22 16:46:19.442953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:46:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 5829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:46:19.468310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-12654d08-fecc-4b9d-b007-3087908ce340 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc697051790>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:19.758006 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-12654d08-fecc-4b9d-b007-3087908ce340 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2" status: 200 len: 346 microversion: 2.1 time: 0.312078 Nov 22 16:46:19.758836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 2/4] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:46:19 2021] GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2 => generated 346 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:19.765125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-73bb85b4-05ea-4cc8-bb79-bbc1a19a1a77 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Action: 'create', calling method: .version_select at 0x7fc69677dc10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2034550285", "metadata": {"Type": "work"}}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:19.772513 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-73bb85b4-05ea-4cc8-bb79-bbc1a19a1a77 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:19.780693 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-73bb85b4-05ea-4cc8-bb79-bbc1a19a1a77 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012999 Nov 22 16:46:19.782453 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 3/5] 10.222.0.61 () {60 vars in 1155 bytes} [Mon Nov 22 16:46:19 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 16:46:19.833459 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1a9b151b-c9ed-4d7a-b912-1b0061346c4a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:19.840023 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1a9b151b-c9ed-4d7a-b912-1b0061346c4a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:20.420036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1a9b151b-c9ed-4d7a-b912-1b0061346c4a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:20.461841 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1a9b151b-c9ed-4d7a-b912-1b0061346c4a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1218 microversion: 2.1 time: 0.677027 Nov 22 16:46:20.462610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 4/6] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:19 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1218 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:20.469432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a7ebe175-dd44-4beb-80cf-ff8122f58b51 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Action: 'create', calling method: .version_select at 0x7fc695f531f0>, body: {"snapshot": {"volume_id": "792494fc-f301-4709-b6f2-37af9c39abb2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2134426990"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:21.064303 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a7ebe175-dd44-4beb-80cf-ff8122f58b51 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.591213 Nov 22 16:46:21.064949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 5/7] 10.222.0.61 () {60 vars in 1161 bytes} [Mon Nov 22 16:46:20 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:21.094089 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e8c8551d-c40c-4ac1-b660-5b2e5f3673af tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Action: 'create', calling method: .version_select at 0x7fc695efc8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1872391521", "metadata": {"Type": "work"}}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:21.104306 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e8c8551d-c40c-4ac1-b660-5b2e5f3673af tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:21.105922 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e8c8551d-c40c-4ac1-b660-5b2e5f3673af tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.033435 Nov 22 16:46:21.107560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 6/8] 10.222.0.61 () {60 vars in 1155 bytes} [Mon Nov 22 16:46:21 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 16:46:21.127474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0daaf250-8070-4af6-a706-c3798ae0c281 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695efca60>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:21.277583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:46:21.278635 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:46:21.279277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:46:21.279874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:46:21.280446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:46:21.319802 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:21.320290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:21.322344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:21.334538 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0daaf250-8070-4af6-a706-c3798ae0c281 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 200 len: 287 microversion: 2.1 time: 0.224876 Nov 22 16:46:21.335736 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 7/9] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:21 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 287 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:21.340602 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:21.351055 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-28b23796-066f-4673-bcc8-cd48133db6e8 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Calling method '.version_select at 0x7fc695f090d0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:21.426585 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-28b23796-066f-4673-bcc8-cd48133db6e8 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] HTTP exception thrown: Volume tempest-invalid-1143715068 could not be found. Nov 22 16:46:21.427654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-28b23796-066f-4673-bcc8-cd48133db6e8 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Returning 404 to user: Volume tempest-invalid-1143715068 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:21.429063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-28b23796-066f-4673-bcc8-cd48133db6e8 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1143715068" status: 404 len: 99 microversion: 2.1 time: 0.090790 Nov 22 16:46:21.430281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 8/10] 10.222.0.61 () {58 vars in 1217 bytes} [Mon Nov 22 16:46:21 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1143715068 => generated 99 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 22 16:46:21.437290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Getting quotas for project cc8e92d816164073980e4b6e167dfcf9. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:21.450735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-edd64264-249d-428a-ade6-f764ee246905 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695efc430>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:21.459218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Getting quotas for user 4fa66795ff3b42759516442170945780 and project cc8e92d816164073980e4b6e167dfcf9. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:21.489415 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:46:21.493525 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:46:21.584575 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-edd64264-249d-428a-ade6-f764ee246905 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.140651 Nov 22 16:46:21.585137 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 9/11] 10.222.0.61 () {58 vars in 1139 bytes} [Mon Nov 22 16:46:21 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:21.598395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0582a48c-2654-43fa-a095-a2b11362522e tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011102 Nov 22 16:46:21.598925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 10/12] 10.222.0.61 () {58 vars in 1139 bytes} [Mon Nov 22 16:46:21 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 16:46:21.615541 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:21.618263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:21.635500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:21.636392 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:21.639960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:21.640419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:21.801414 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c1326dbc-1de9-4ff5-954b-3a23ae2d5b92 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.399812 Nov 22 16:46:21.802098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 3/13] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:46:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 3401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:46:21.819215 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d03ef2b7-3c19-40a3-bab9-fe6fbf53b25e tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc696f37820>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:21.918293 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d03ef2b7-3c19-40a3-bab9-fe6fbf53b25e tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 200 len: 287 microversion: 2.1 time: 0.108588 Nov 22 16:46:21.919680 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 4/14] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:21 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:21.929074 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a54ee07b-4e52-41ae-9d23-adc8825e6dd0 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007694 Nov 22 16:46:21.934675 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 5/15] 10.222.0.61 () {58 vars in 1136 bytes} [Mon Nov 22 16:46:21 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 16:46:21.953965 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-32b7070e-48bc-482c-aec3-167f39697fae tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:21.954740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-32b7070e-48bc-482c-aec3-167f39697fae tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:21.985247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:22.005064 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-55f10905-8c1e-4747-98bb-0b716c9306ae tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1222 microversion: 2.1 time: 0.400579 Nov 22 16:46:22.014500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 11/16] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:21 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1222 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:22.046657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-53ba1aa3-67b5-4a4b-98ea-c852712e9b9f tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Calling method '.version_select at 0x7fc695e7c9d0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:22.127469 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-53ba1aa3-67b5-4a4b-98ea-c852712e9b9f tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] HTTP exception thrown: Volume a22e8606-27ab-4953-89f1-f074a3a83b4c could not be found. Nov 22 16:46:22.128094 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-53ba1aa3-67b5-4a4b-98ea-c852712e9b9f tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Returning 404 to user: Volume a22e8606-27ab-4953-89f1-f074a3a83b4c could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:22.128989 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-53ba1aa3-67b5-4a4b-98ea-c852712e9b9f tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/a22e8606-27ab-4953-89f1-f074a3a83b4c" status: 404 len: 109 microversion: 2.1 time: 0.110652 Nov 22 16:46:22.129540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 12/17] 10.222.0.61 () {58 vars in 1247 bytes} [Mon Nov 22 16:46:22 2021] DELETE /compute/v2.1/os-volumes/a22e8606-27ab-4953-89f1-f074a3a83b4c => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:46:22.147590 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6b5f3c4d-6646-458a-9ad5-ebe8bd1df376 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Calling method '.version_select at 0x7fc695e7c940>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:22.159080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-32b7070e-48bc-482c-aec3-167f39697fae tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:22.204356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-6b5f3c4d-6646-458a-9ad5-ebe8bd1df376 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] HTTP exception thrown: Volume 408757e6-a03d-40bd-b858-2fcbd2171f2f could not be found. Nov 22 16:46:22.204964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6b5f3c4d-6646-458a-9ad5-ebe8bd1df376 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] Returning 404 to user: Volume 408757e6-a03d-40bd-b858-2fcbd2171f2f could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:22.205818 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6b5f3c4d-6646-458a-9ad5-ebe8bd1df376 tempest-VolumesNegativeTest-1691774671 tempest-VolumesNegativeTest-1691774671-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/408757e6-a03d-40bd-b858-2fcbd2171f2f" status: 404 len: 109 microversion: 2.1 time: 0.069646 Nov 22 16:46:22.216536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 13/18] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:46:22 2021] GET /compute/v2.1/os-volumes/408757e6-a03d-40bd-b858-2fcbd2171f2f => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 16:46:22.216968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-32b7070e-48bc-482c-aec3-167f39697fae tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1214 microversion: 2.1 time: 0.279156 Nov 22 16:46:22.216968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 6/19] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:21 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:22.933334 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ed82afb3-bf2c-48ff-997f-4edcd5cbe1cc tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695efc310>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:23.024899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ed82afb3-bf2c-48ff-997f-4edcd5cbe1cc tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 200 len: 287 microversion: 2.1 time: 0.095941 Nov 22 16:46:23.026037 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 14/20] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:22 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:46:23.040137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:23.041001 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:23.053535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:23.053861 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:23.063219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:23.064133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:23.233267 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a5df2a2d-502d-4d5c-bf9e-2e7fe13a2649 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:23.234229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a5df2a2d-502d-4d5c-bf9e-2e7fe13a2649 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:23.825682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a5df2a2d-502d-4d5c-bf9e-2e7fe13a2649 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:23.834465 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a5df2a2d-502d-4d5c-bf9e-2e7fe13a2649 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1214 microversion: 2.1 time: 0.605491 Nov 22 16:46:23.856295 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 15/21] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:23 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1214 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:24.040889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ebee0ae0-0aa2-4fa4-920e-06b1c24dc7c9 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e8ad30>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:24.069687 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:24.121868 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b4385287-55a7-41fa-956e-5a2d8e639019 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1222 microversion: 2.1 time: 1.086435 Nov 22 16:46:24.142228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 7/22] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:23 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1222 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:24.154511 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ebee0ae0-0aa2-4fa4-920e-06b1c24dc7c9 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 200 len: 287 microversion: 2.1 time: 0.118421 Nov 22 16:46:24.155087 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 16/23] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:24 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:24.855000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:24.855959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:24.867678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:24.873921 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:24.877183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:24.878795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:25.164125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:25.165693 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:25.179855 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:25.182914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:25.183784 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:25.184269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:25.220780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:25.261906 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cbfe8a69-2f55-495e-b988-8dab83c9acc8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1210 microversion: 2.1 time: 0.410717 Nov 22 16:46:25.265677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 8/24] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:24 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1210 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:25.281874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0958e890-f443-4d79-bb6f-6e7b8956c6ee tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e7ee50>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:25.315694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:25.343813 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-86e6c371-5c3c-4e38-80ab-6c601082d9fd tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1270 microversion: 2.1 time: 0.187427 Nov 22 16:46:25.344915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 17/25] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:25 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:25.370223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0958e890-f443-4d79-bb6f-6e7b8956c6ee tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 200 len: 288 microversion: 2.1 time: 0.098564 Nov 22 16:46:25.371863 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 9/26] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:25 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:25.388184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-75d47062-090f-4209-b639-4603a55a88ce tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e23430>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:25.575105 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-75d47062-090f-4209-b639-4603a55a88ce tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 202 len: 0 microversion: 2.1 time: 0.193689 Nov 22 16:46:25.575979 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 18/27] 10.222.0.61 () {58 vars in 1253 bytes} [Mon Nov 22 16:46:25 2021] DELETE /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:46:25.585742 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-88efa61d-8efa-4d26-9bbb-840521756403 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e70940>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:25.697938 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-88efa61d-8efa-4d26-9bbb-840521756403 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 200 len: 287 microversion: 2.1 time: 0.115818 Nov 22 16:46:25.699467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 10/28] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:25 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:26.305615 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:26.306749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:26.361127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:26.383368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:26.392356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:26.392863 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:26.404891 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:26.406002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:26.439595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:26.440453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:26.457246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:26.458072 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:27.336622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:27.360311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:27.379951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-78c53b1c-cde8-400c-9696-6049f922474f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1266 microversion: 2.1 time: 1.069979 Nov 22 16:46:27.383629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 19/29] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:26 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1266 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:27.422813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6f62539f-2767-4465-8eab-4606f4a0e9b3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1276 microversion: 2.1 time: 1.025071 Nov 22 16:46:27.422813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 11/30] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:26 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1276 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:27.437735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0f99f1ea-1917-434f-b072-7ccc59963e0f tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e34160>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:27.523065 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-0f99f1ea-1917-434f-b072-7ccc59963e0f tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] HTTP exception thrown: Snapshot eacc0ff7-b228-405e-9d98-265d731ede96 could not be found. Nov 22 16:46:27.526749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0f99f1ea-1917-434f-b072-7ccc59963e0f tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Returning 404 to user: Snapshot eacc0ff7-b228-405e-9d98-265d731ede96 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:27.528621 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0f99f1ea-1917-434f-b072-7ccc59963e0f tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96" status: 404 len: 111 microversion: 2.1 time: 0.139473 Nov 22 16:46:27.529881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 20/31] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:46:27 2021] GET /compute/v2.1/os-snapshots/eacc0ff7-b228-405e-9d98-265d731ede96 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:46:27.539000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-70101506-9449-47ce-9902-12651cf82b30 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e8b310>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:27.814180 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-70101506-9449-47ce-9902-12651cf82b30 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2" status: 202 len: 0 microversion: 2.1 time: 0.279139 Nov 22 16:46:27.819642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 12/32] 10.222.0.61 () {58 vars in 1247 bytes} [Mon Nov 22 16:46:27 2021] DELETE /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:46:27.834446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-61851f40-d89b-440a-b9d7-fa397236703c tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e4e9d0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:27.947025 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-61851f40-d89b-440a-b9d7-fa397236703c tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2" status: 200 len: 345 microversion: 2.1 time: 0.120656 Nov 22 16:46:27.949428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 21/33] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:46:27 2021] GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:28.411392 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:28.412557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:28.445907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:28.446944 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:28.474084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:28.474599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:28.475582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:28.477247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:28.477974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:28.478669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:28.479595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:28.488669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:28.709374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:28.728139 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-23145e6a-427b-4763-966a-65227ff589a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1272 microversion: 2.1 time: 0.330656 Nov 22 16:46:28.729272 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 13/34] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:28 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:28.970161 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-480c9adf-6df1-4111-9d83-c515e087cace tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e4aa60>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:29.082983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:29.097842 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-94b3a6f9-2a39-4a1e-98c6-a42e1ee7d7bc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.658292 Nov 22 16:46:29.116488 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 22/35] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:28 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:29.143815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-480c9adf-6df1-4111-9d83-c515e087cace tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] HTTP exception thrown: Volume 792494fc-f301-4709-b6f2-37af9c39abb2 could not be found. Nov 22 16:46:29.146434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-480c9adf-6df1-4111-9d83-c515e087cace tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Returning 404 to user: Volume 792494fc-f301-4709-b6f2-37af9c39abb2 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:29.152140 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-480c9adf-6df1-4111-9d83-c515e087cace tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2" status: 404 len: 109 microversion: 2.1 time: 0.189727 Nov 22 16:46:29.154356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 14/36] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:46:28 2021] GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2 => generated 109 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:46:29.181347 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f28da104-3c4d-4ff9-a78d-be9c408061ba tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc695e8a5e0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:29.271812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-f28da104-3c4d-4ff9-a78d-be9c408061ba tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] HTTP exception thrown: Volume 792494fc-f301-4709-b6f2-37af9c39abb2 could not be found. Nov 22 16:46:29.272836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f28da104-3c4d-4ff9-a78d-be9c408061ba tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Returning 404 to user: Volume 792494fc-f301-4709-b6f2-37af9c39abb2 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:29.273963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f28da104-3c4d-4ff9-a78d-be9c408061ba tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2" status: 404 len: 109 microversion: 2.1 time: 0.098815 Nov 22 16:46:29.275185 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 23/37] 10.222.0.61 () {58 vars in 1247 bytes} [Mon Nov 22 16:46:29 2021] DELETE /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:46:29.285711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-32454316-cd09-4c9f-bef6-24a4d497d571 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Calling method '.version_select at 0x7fc69702f700>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:29.376636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-32454316-cd09-4c9f-bef6-24a4d497d571 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] HTTP exception thrown: Volume 792494fc-f301-4709-b6f2-37af9c39abb2 could not be found. Nov 22 16:46:29.378382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-32454316-cd09-4c9f-bef6-24a4d497d571 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] Returning 404 to user: Volume 792494fc-f301-4709-b6f2-37af9c39abb2 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:46:29.380000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-32454316-cd09-4c9f-bef6-24a4d497d571 tempest-VolumesSnapshotsTestJSON-1290221181 tempest-VolumesSnapshotsTestJSON-1290221181-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2" status: 404 len: 109 microversion: 2.1 time: 0.099080 Nov 22 16:46:29.381250 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 15/38] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:46:29 2021] GET /compute/v2.1/os-volumes/792494fc-f301-4709-b6f2-37af9c39abb2 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:46:29.748504 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:29.750914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:29.779951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:29.782595 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:29.791964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:29.797575 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:30.125937 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:30.126805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:30.140595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:30.145281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:30.152111 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:30.154555 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:32.507414 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:32.532819 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1a6e2e22-6b00-4dc3-ac3f-7a0d33867031 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 2.787588 Nov 22 16:46:32.555594 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 24/39] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:29 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 2814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:32.876351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:32.895575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9edf8552-b01a-4b4b-bb02-b5ad16d8ebe8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 2.768196 Nov 22 16:46:32.897630 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 16/40] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:30 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 2776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:33.562332 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:33.563695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:33.583938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:33.586049 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:33.608967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:33.611768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:33.933659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:33.940748 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:33.958314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:33.958788 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:33.959626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:33.960098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:35.377197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:35.414719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4da44fc3-4d9a-4109-a338-32fd627868a5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 1.856525 Nov 22 16:46:35.415337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 25/41] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:33 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:35.474884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:35.529025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7263abc8-8e95-47d1-be71-8d900c03ee2b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 1.584680 Nov 22 16:46:35.540707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 17/42] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:33 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:36.094221 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0ff884e8-b257-47f0-b80a-cfab11fdcdf6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'create', calling method: .version_select at 0x7fc695dd9040>, body: {"keypair": {"name": "tempest-keypair-1526480785"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:36.186131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-0ff884e8-b257-47f0-b80a-cfab11fdcdf6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:36.214937 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-0ff884e8-b257-47f0-b80a-cfab11fdcdf6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for user d7a9d997c1644148ba43d758c3e02ef6 and project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:36.446263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:36.446263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:36.454843 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:36.455338 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:36.465882 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:36.467178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:37.408435 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:37.432922 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-67332332-13b0-4fb7-ace2-a865c88c36b5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.990211 Nov 22 16:46:37.438584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 18/43] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:36 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:37.454505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:37.462563 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:37.490702 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:37.491759 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:37.493576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:37.495295 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:37.644982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-0ff884e8-b257-47f0-b80a-cfab11fdcdf6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:37.659697 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-0ff884e8-b257-47f0-b80a-cfab11fdcdf6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for user d7a9d997c1644148ba43d758c3e02ef6 and project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:37.723451 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0ff884e8-b257-47f0-b80a-cfab11fdcdf6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.294545 Nov 22 16:46:37.727973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 26/44] 10.222.0.61 () {62 vars in 1198 bytes} [Mon Nov 22 16:46:35 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2300 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 16:46:38.359964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:38.371596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ac0dac39-eaaa-401f-96d6-d6abd2345b11 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.931108 Nov 22 16:46:38.375337 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 19/45] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:37 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:38.466650 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:38.467534 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:38.503544 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:38.504393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:38.505445 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:38.510376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:39.402888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:39.423906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a9cb1478-2034-407a-b13b-2833f5f4a7ac tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.961220 Nov 22 16:46:39.452171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 27/46] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:38 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:39.554174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:39.555202 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:39.622832 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:39.623689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:39.632476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:39.633067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:40.275478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-e22e73b7-59c6-4ea5-89e2-9afb379ab6ff req-ada8115c-b53e-45f8-8ea1-8670fe845f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46aaa1f5-cd61-46b1-9424-8444b96c948e", "tag": "948e5c76-68b7-441c-b331-9380ea7a34e2"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:40.285348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:46:40.285348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:46:40.317988 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:40.344182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e22e73b7-59c6-4ea5-89e2-9afb379ab6ff req-ada8115c-b53e-45f8-8ea1-8670fe845f9b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:40.344612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e22e73b7-59c6-4ea5-89e2-9afb379ab6ff req-ada8115c-b53e-45f8-8ea1-8670fe845f9b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:40.370144 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-03927047-7a50-44af-a1b0-125123d61668 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.869106 Nov 22 16:46:40.390028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 28/47] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:39 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:40.450894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-e22e73b7-59c6-4ea5-89e2-9afb379ab6ff req-ada8115c-b53e-45f8-8ea1-8670fe845f9b service nova] Creating event network-changed:948e5c76-68b7-441c-b331-9380ea7a34e2 for instance 46aaa1f5-cd61-46b1-9424-8444b96c948e on hv-cinder-80473 Nov 22 16:46:40.474253 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e22e73b7-59c6-4ea5-89e2-9afb379ab6ff req-ada8115c-b53e-45f8-8ea1-8670fe845f9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=133216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 16:46:40.478143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:40.482095 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:40.483594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:40.491320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:40.494434 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:40.495250 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:40.513782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:40.522797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:40.526262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:40.528156 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:40.577487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.compute.rpcapi [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 16:46:40.581460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] Releasing lock "compute-rpcapi-router" {{(pid=133216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 16:46:40.674871 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e0b9f4ad-66ff-498e-a241-1af4b17e6a34 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.419037 Nov 22 16:46:40.676057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 20/48] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:46:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:40.891777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:40.906576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-70f6ef5f-b35d-4ad4-b2b9-fce2400d3150 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.417014 Nov 22 16:46:40.919850 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 29/49] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:40 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:41.277084 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1490844682", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ef43581-0b2d-45c7-919f-e29c34327fb4"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:41.386296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] validate_networks() for [('5ef43581-0b2d-45c7-919f-e29c34327fb4', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:46:41.405034 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:41.411912 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:41.421135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:41.421867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:41.424963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:41.425632 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:41.862040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:41.893849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a839798c-83d1-420e-af62-64cdded58f62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.492425 Nov 22 16:46:41.899091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 30/50] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:41 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:41.938462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:41.939299 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:41.954871 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:41.959128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:41.960407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:41.961864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:42.919153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:42.956537 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f20d3fac-9ce3-47f5-b66e-122ba58f6731 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 1.020222 Nov 22 16:46:42.960748 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 31/51] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:41 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:42.988624 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-60391f35-3fa5-45a2-8ee5-d0c1d069103f req-b13826ae-d7cd-416f-a380-4d2db51c20fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c48729-9d12-41e3-a283-8ff2f04f31a3", "tag": "49146094-041b-4242-89d8-6a39f4cd1968"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:43.004508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:46:43.004508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:46:43.048494 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-60391f35-3fa5-45a2-8ee5-d0c1d069103f req-b13826ae-d7cd-416f-a380-4d2db51c20fb service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.054234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-60391f35-3fa5-45a2-8ee5-d0c1d069103f req-b13826ae-d7cd-416f-a380-4d2db51c20fb service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.106143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:46:43.113722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:46:43.113722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:46:43.113722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:46:43.113722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:46:43.149950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.158648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.159651 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-60391f35-3fa5-45a2-8ee5-d0c1d069103f req-b13826ae-d7cd-416f-a380-4d2db51c20fb service nova] Creating event network-changed:49146094-041b-4242-89d8-6a39f4cd1968 for instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 on hv-cinder-80473 Nov 22 16:46:43.165518 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-60391f35-3fa5-45a2-8ee5-d0c1d069103f req-b13826ae-d7cd-416f-a380-4d2db51c20fb service nova] Acquired lock "compute-rpcapi-router" {{(pid=133215) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 16:46:43.170796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.172517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.173710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.173991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.175255 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.191920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.197963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.compute.rpcapi [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 16:46:43.200151 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] Releasing lock "compute-rpcapi-router" {{(pid=133215) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 16:46:43.234309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Getting quotas for project 46cf61d791e04bc483cab9a8f8745008. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:43.255443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-41f24440-3a22-44dd-b10a-56f31db8f9a6 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289563 Nov 22 16:46:43.256815 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 32/52] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:46:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:43.261032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Getting quotas for user 112824f29e5f44c283f56b34ea893d42 and project 46cf61d791e04bc483cab9a8f8745008. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:43.264875 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:43.267563 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:43.285335 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:46:43.285860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.287589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.290258 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:46:43.292574 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:43.293740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:43.428344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-13ce97a3-5906-49cd-b71d-63c3174d831b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.739088 Nov 22 16:46:43.429908 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 21/53] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:46:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 2742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 16:46:43.463893 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7572e11d-f28e-4191-9dcf-ff002bcc3511 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:43.469522 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7572e11d-f28e-4191-9dcf-ff002bcc3511 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:43.696613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7572e11d-f28e-4191-9dcf-ff002bcc3511 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:43.710325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7572e11d-f28e-4191-9dcf-ff002bcc3511 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1222 microversion: 2.1 time: 0.261051 Nov 22 16:46:43.722787 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 22/54] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:43 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:43.816281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:43.852555 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c7dd3249-cbf2-42ce-aadc-e78b9bb6a765 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.594276 Nov 22 16:46:43.861966 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 33/55] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:43 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:43.986721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:43.992582 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:44.015932 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:44.016624 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:44.018195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:44.034341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:44.340639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-837421633", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ef43581-0b2d-45c7-919f-e29c34327fb4"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:44.647198 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] validate_networks() for [('5ef43581-0b2d-45c7-919f-e29c34327fb4', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:46:44.997583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:45.029814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f7696f8f-1753-4cef-9411-82969e316c1b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 1.055149 Nov 22 16:46:45.039216 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 23/56] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:43 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:45.073353 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-912809767", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c9a20d6-fe56-4f54-a96e-edd086f5cc72"}], "security_groups": [{"name": "tempest-securitygroup--1422873370"}], "key_name": "tempest-keypair-1526480785", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:45.912779 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] validate_networks() for [('2c9a20d6-fe56-4f54-a96e-edd086f5cc72', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:46:48.520949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:46:48.533533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:46:48.533533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:46:48.533533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:46:48.533533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:46:48.630676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:48.632994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:48.638544 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:48.643437 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:48.733311 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Getting quotas for project 46cf61d791e04bc483cab9a8f8745008. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:48.747808 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Getting quotas for user 112824f29e5f44c283f56b34ea893d42 and project 46cf61d791e04bc483cab9a8f8745008. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:48.808262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:46:48.831867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:46:49.085668 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7a61d7d5-ea99-4848-bb56-08dca85d203e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.745526 Nov 22 16:46:49.092698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 34/57] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:46:44 2021] POST /compute/v2.1/servers => generated 383 bytes in 4760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:46:49.098656 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:49.105493 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:49.121567 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:49.122291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:49.123913 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:49.126602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:50.240243 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:46:50.241511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:46:50.242162 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:46:50.242864 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:46:50.243470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:46:50.257221 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:50.258143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:50.259515 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:50.260751 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:50.292518 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for project 7531002e08024f178aeaba0f112be50a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:46:50.299617 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for user d7a9d997c1644148ba43d758c3e02ef6 and project 7531002e08024f178aeaba0f112be50a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:46:50.316663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:46:50.319727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:46:50.449688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:50.453788 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b3735f2e-a25e-4858-bd9c-9c25e4c27bae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.406548 Nov 22 16:46:50.455745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 24/58] 10.222.0.61 () {62 vars in 1187 bytes} [Mon Nov 22 16:46:45 2021] POST /compute/v2.1/servers => generated 402 bytes in 5415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 16:46:50.466659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:50.469323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:50.491375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:50.495265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:50.498092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:50.499745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:50.525731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a8887819-b98c-4c95-9fb9-71e6a75cf930 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 1.416856 Nov 22 16:46:50.532287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 35/59] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:49 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:50.563271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:50.570455 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:50.610405 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:50.621522 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:50.625797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:50.626663 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:51.248195 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:51.279188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-89a99011-9d86-45b8-88c1-ebfcd9b18648 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1217 microversion: 2.1 time: 0.738035 Nov 22 16:46:51.300582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 36/60] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:50 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1217 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:51.310605 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8cbd8f91-329b-41ca-b389-257e9d649caf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:51.312131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8cbd8f91-329b-41ca-b389-257e9d649caf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:51.643499 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8cbd8f91-329b-41ca-b389-257e9d649caf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:51.672931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8cbd8f91-329b-41ca-b389-257e9d649caf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:51.683135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8cbd8f91-329b-41ca-b389-257e9d649caf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:51.685569 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8cbd8f91-329b-41ca-b389-257e9d649caf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1281 microversion: 2.20 time: 0.382883 Nov 22 16:46:51.691789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 37/61] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:46:51 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1281 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:46:51.722744 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:51.724354 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:51.736487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:51.737609 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:51.739770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:51.740833 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:51.909644 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:51.933099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f88c1336-3b0b-495b-8d37-7f7b656688f8 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 1.473283 Nov 22 16:46:51.934088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 25/62] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:50 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:52.255606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:52.269014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9e594713-d2ae-4eb9-a0b9-577cd4467812 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.562136 Nov 22 16:46:52.269657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 38/63] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:51 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:52.317676 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:52.319428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:52.333790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:52.335444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:52.338219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:52.339658 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:52.598528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:52.663371 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d31b8f74-1e14-45c5-847e-4746e24621d9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1279 microversion: 2.1 time: 0.352087 Nov 22 16:46:52.677534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 26/64] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:52 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1279 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:52.727431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:52.728960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:52.744833 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:52.746568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:52.750076 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:52.750782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:52.954891 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:52.955514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:52.973386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:52.974806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:52.979615 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:52.988789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:52.989252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:52.993169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:53.001553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:53.011934 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-67d549f0-d22b-4b3e-88a2-688d8dc33d01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1341 microversion: 2.20 time: 0.288655 Nov 22 16:46:53.012586 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 39/65] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:46:52 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1341 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:46:53.295015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:53.295810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:53.309737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:53.313884 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:53.319714 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:53.320958 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:53.851040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:53.878298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f7ba97e1-fc55-4aa1-ab72-e92ae5feb71b tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.924839 Nov 22 16:46:53.881714 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 27/66] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:52 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:53.900533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:53.904795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:53.927806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:53.929789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:53.932362 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:53.932895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:53.982158 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:53.992213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2f511c15-fa80-4930-88e1-b988921cab5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.703097 Nov 22 16:46:54.001646 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 40/67] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:53 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:54.032080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:54.033005 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:54.045744 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:54.046564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:54.047775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:54.048492 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:54.163300 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:54.177223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-edf1438d-90ea-4406-9b6e-35d5e08ba29d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1279 microversion: 2.1 time: 0.294119 Nov 22 16:46:54.182834 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 28/68] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:53 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1279 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:54.249725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:54.258605 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:54.265588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:54.266938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-86bc3104-807a-4198-b50a-753bde633d5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1339 microversion: 2.20 time: 0.238991 Nov 22 16:46:54.272757 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 41/69] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:46:54 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1339 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:46:54.908628 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:54.914774 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:54.951138 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:54.951959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:54.957164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:54.960774 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:55.025959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:55.026878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:55.038182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:55.042042 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:55.050955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:55.051402 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:56.044997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:56.064636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ef49c349-4cd4-49b5-966f-bdc8221a85cd tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 1.165843 Nov 22 16:46:56.066670 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 29/70] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:54 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:56.081899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:56.084607 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:56.089920 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:56.103237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:56.111917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-78194537-4c03-4f0e-8bac-2fc1cd62270f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 1.088692 Nov 22 16:46:56.112930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 42/71] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:55 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:56.113741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:56.115669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:56.116671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:56.122090 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:56.123071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:56.143162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:56.143938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:56.145373 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:56.146144 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:56.895612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:56.904683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:56.906280 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:56.907635 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4486f0e2-a1d1-42df-89ac-a8bf219ae047 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.791949 Nov 22 16:46:56.926504 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 43/72] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:46:56 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:46:56.935939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:56.960226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-249d8720-9771-40c0-8799-a05f08187f45 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.889776 Nov 22 16:46:56.961138 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 30/73] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:56 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:57.092345 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:57.104834 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:57.116923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:57.117591 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:57.118820 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:57.119674 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:57.140670 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:57.141493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:57.155754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:57.162791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:57.166671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:57.167239 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:57.840763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:57.858990 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:57.876860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-99f8b117-7e71-4afc-a8c7-542bb237d674 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.790986 Nov 22 16:46:57.878579 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-522f87fd-940b-474c-9205-ba4a86117d31 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.741764 Nov 22 16:46:57.887874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 31/74] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:57 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:46:57.888223 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 44/75] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:57 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:57.930366 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:57.930847 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:57.948212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:57.951662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:57.953760 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:57.958720 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:58.238713 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-0726a9de-3f3e-40c5-b106-c6cebe559185 req-ec6e389f-ec9d-4cf6-8c4f-468ba7124005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3997288-5b3f-4013-bcad-f59ce5f32db3", "tag": "dc6ce4e8-3940-405a-82fa-ee8b6d0fd6d3"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:58.244100 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:46:58.244100 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:46:58.278733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-0726a9de-3f3e-40c5-b106-c6cebe559185 req-ec6e389f-ec9d-4cf6-8c4f-468ba7124005 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:58.279770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-0726a9de-3f3e-40c5-b106-c6cebe559185 req-ec6e389f-ec9d-4cf6-8c4f-468ba7124005 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:58.338394 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-0726a9de-3f3e-40c5-b106-c6cebe559185 req-ec6e389f-ec9d-4cf6-8c4f-468ba7124005 service nova] Creating event network-changed:dc6ce4e8-3940-405a-82fa-ee8b6d0fd6d3 for instance a3997288-5b3f-4013-bcad-f59ce5f32db3 on hv-cinder-80473 Nov 22 16:46:58.363380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-0726a9de-3f3e-40c5-b106-c6cebe559185 req-ec6e389f-ec9d-4cf6-8c4f-468ba7124005 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478555 Nov 22 16:46:58.367467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 32/76] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:46:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:58.391711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:58.401979 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:58.419150 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:58.420081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:58.421847 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:58.425951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:58.579207 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:58.591270 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:58.596206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:58.597947 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-871623cb-5313-4ade-ad55-aa6b52797c37 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.673191 Nov 22 16:46:58.598797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 45/77] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:46:57 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:46:58.653051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-1eee8d9d-1738-445e-91e2-e6fc075e1ccc req-efd1f2a0-a95c-49b5-8ef6-919624c668c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "286a87c0-cd89-4f83-8b58-a8ee9f2636b3", "tag": "c2cb7311-7775-45f5-a309-0e88da36762b"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:58.655307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:46:58.655307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:46:58.714207 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-1eee8d9d-1738-445e-91e2-e6fc075e1ccc req-efd1f2a0-a95c-49b5-8ef6-919624c668c0 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:58.728767 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-1eee8d9d-1738-445e-91e2-e6fc075e1ccc req-efd1f2a0-a95c-49b5-8ef6-919624c668c0 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:58.761221 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-1eee8d9d-1738-445e-91e2-e6fc075e1ccc req-efd1f2a0-a95c-49b5-8ef6-919624c668c0 service nova] Creating event network-changed:c2cb7311-7775-45f5-a309-0e88da36762b for instance 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 on hv-cinder-80473 Nov 22 16:46:58.769320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-1eee8d9d-1738-445e-91e2-e6fc075e1ccc req-efd1f2a0-a95c-49b5-8ef6-919624c668c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143457 Nov 22 16:46:58.772254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 46/78] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:59.349551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:46:59.371077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3a9f7a8a-d2b0-4b65-bc30-d175cff1db20 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.997152 Nov 22 16:46:59.386897 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 33/79] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:58 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:46:59.395036 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:59.396215 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:59.412057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:59.412840 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:59.413520 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:59.414085 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:59.441467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-ab306b69-5f82-450d-8f40-24a1f8daf919 req-1d4e32c7-d36b-4462-98e6-375bcf1d4356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46aaa1f5-cd61-46b1-9424-8444b96c948e", "name": "network-vif-plugged", "status": "completed", "tag": "948e5c76-68b7-441c-b331-9380ea7a34e2"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:46:59.444592 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:46:59.444592 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:46:59.462954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-ab306b69-5f82-450d-8f40-24a1f8daf919 req-1d4e32c7-d36b-4462-98e6-375bcf1d4356 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:59.467329 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-ab306b69-5f82-450d-8f40-24a1f8daf919 req-1d4e32c7-d36b-4462-98e6-375bcf1d4356 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:59.500261 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-ab306b69-5f82-450d-8f40-24a1f8daf919 req-1d4e32c7-d36b-4462-98e6-375bcf1d4356 service nova] Creating event network-vif-plugged:948e5c76-68b7-441c-b331-9380ea7a34e2 for instance 46aaa1f5-cd61-46b1-9424-8444b96c948e on hv-cinder-80473 Nov 22 16:46:59.506505 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-ab306b69-5f82-450d-8f40-24a1f8daf919 req-1d4e32c7-d36b-4462-98e6-375bcf1d4356 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.730681 Nov 22 16:46:59.508023 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 47/80] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:46:59.516971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:46:59.518078 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:46:59.532063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:59.533136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:59.534763 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:46:59.535396 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:46:59.982161 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:00.004153 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-abf644ca-e720-43a5-86e5-4bc94f3cd0a3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.621415 Nov 22 16:47:00.005399 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 34/81] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:59 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:00.014122 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:00.014968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:00.043470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:00.049137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:00.051633 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:00.056832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:00.245783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:00.273388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-750b9497-9d3b-4209-929a-9a36202f002c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.762777 Nov 22 16:47:00.275688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 48/82] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:46:59 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:00.415169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:00.420708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:00.471490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:00.473366 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:00.480234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:00.481195 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:00.863426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:00.883247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:00.886728 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:00.891584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-695b7fa7-92aa-41a2-abb5-6ca708c86ca0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.878638 Nov 22 16:47:00.892465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 35/83] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:00 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:01.036835 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:01.043428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:01.074218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:01.083505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.087176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.087176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.087176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.109130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-85a23aef-ce44-48d8-bd56-27bdd568c78d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.711853 Nov 22 16:47:01.124702 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 49/84] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:00 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:01.164144 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-52400903-f4a4-42e2-84ce-cd84d6b41a87 req-b8271b15-e62d-4a1d-84c2-a2f9c761cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:01.166566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:01.166566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:47:01.180672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-52400903-f4a4-42e2-84ce-cd84d6b41a87 req-b8271b15-e62d-4a1d-84c2-a2f9c761cd21 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.183018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-52400903-f4a4-42e2-84ce-cd84d6b41a87 req-b8271b15-e62d-4a1d-84c2-a2f9c761cd21 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.229977 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-52400903-f4a4-42e2-84ce-cd84d6b41a87 req-b8271b15-e62d-4a1d-84c2-a2f9c761cd21 service nova] Creating event network-changed:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:47:01.239268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-52400903-f4a4-42e2-84ce-cd84d6b41a87 req-b8271b15-e62d-4a1d-84c2-a2f9c761cd21 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078122 Nov 22 16:47:01.240897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 50/85] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:01.303608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:01.304590 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:01.327436 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.328923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.330677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.332469 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.497857 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:01.530875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ccd20fda-cb0c-4206-81bb-e2f0664e41cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.504159 Nov 22 16:47:01.552016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 36/86] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:01 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:01.568092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-8d742576-bc5a-4661-9809-b932cbae6f3e req-dc47a0ad-7f8f-4066-b503-d64cc7015998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c48729-9d12-41e3-a283-8ff2f04f31a3", "name": "network-vif-plugged", "status": "completed", "tag": "49146094-041b-4242-89d8-6a39f4cd1968"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:01.573634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:01.573634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:47:01.584651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-8d742576-bc5a-4661-9809-b932cbae6f3e req-dc47a0ad-7f8f-4066-b503-d64cc7015998 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.585791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-8d742576-bc5a-4661-9809-b932cbae6f3e req-dc47a0ad-7f8f-4066-b503-d64cc7015998 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.604120 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-8d742576-bc5a-4661-9809-b932cbae6f3e req-dc47a0ad-7f8f-4066-b503-d64cc7015998 service nova] Creating event network-vif-plugged:49146094-041b-4242-89d8-6a39f4cd1968 for instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 on hv-cinder-80473 Nov 22 16:47:01.613109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-8d742576-bc5a-4661-9809-b932cbae6f3e req-dc47a0ad-7f8f-4066-b503-d64cc7015998 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058374 Nov 22 16:47:01.615928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 37/87] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:01.733264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:01.751016 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0d6df2f2-e784-4846-b051-e75e71520308 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.458583 Nov 22 16:47:01.752302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 51/88] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:01 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:01.920016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:01.928305 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:01.951089 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.954478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:01.955731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:01.956403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:02.138141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:02.144131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:02.173932 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:02.174629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:02.175634 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:02.176279 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:02.312500 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:02.354340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:02.363436 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:02.371444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-96b76dc9-a286-48a1-9446-d282e3d4f8ac tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.460871 Nov 22 16:47:02.372560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 38/89] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:01 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:02.468258 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:02.480877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6b4eb127-f590-444a-a429-ebc153532b31 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.351932 Nov 22 16:47:02.482086 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 52/90] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:02 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:02.570763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:02.572556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:02.585063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:02.586401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:02.588496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:02.591295 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:02.771091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:02.772107 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:02.794859 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:02.796247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:02.797363 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:02.798950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:03.011207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:03.022094 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-920ce799-c610-47be-9242-7e909339fd70 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1318 microversion: 2.1 time: 0.466902 Nov 22 16:47:03.041892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 39/91] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:02 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:03.106515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:03.123025 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b394ee8d-a980-45da-9a4e-35255b3cc6d3 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.354676 Nov 22 16:47:03.123951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 53/92] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:02 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:03.402225 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:03.403528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:03.437101 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:03.444825 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:03.453107 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:03.454156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:03.513722 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:03.514876 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:03.538654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:03.539292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:03.542427 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:03.542427 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:04.023626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:04.058642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:04.078297 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:04.095215 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-60668597-3f60-415f-acc9-3e7136289108 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.692040 Nov 22 16:47:04.098232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 40/93] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:03 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:04.119048 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:04.124844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:04.145712 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:04.146788 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:04.148409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:04.154960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:04.177461 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:04.233323 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e3dd4f4b-cf50-4c4f-a3ed-8d65c39039d2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.727139 Nov 22 16:47:04.238098 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 54/94] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:03 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:04.275298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:04.276397 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:04.325729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:04.334953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:04.336351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:04.337090 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:04.673831 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:04.689667 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3f98a44f-1fd6-46d8-b0a5-f6980d156fc5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1508 microversion: 2.1 time: 0.587316 Nov 22 16:47:04.703447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 41/95] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:04 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1508 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:04.879386 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:04.906906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b15227b4-381a-4ff9-9a05-e82f322b8fe1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1314 microversion: 2.1 time: 0.666652 Nov 22 16:47:04.911622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 55/96] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:04 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:05.122103 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:05.127205 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:05.142003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:05.143194 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:05.144931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:05.145899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:05.290810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:05.292214 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:05.302491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:05.304367 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:05.305655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:05.309330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:05.805578 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:05.834737 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:05.870166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:05.872103 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0ee4699d-00ed-40cf-81c3-064469a4788e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.757339 Nov 22 16:47:05.881470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 42/97] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:05 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:47:05.905364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:05.918998 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2197a72e-0f13-401a-8044-7f1309850690 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.651540 Nov 22 16:47:05.939169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:05.940365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:05.943487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 56/98] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:05 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:05.953979 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:05.954831 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:05.956597 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:05.957898 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:06.235029 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-bcdb4325-41f9-4c5a-a45d-a516e276c634 req-6c832902-e353-41b9-99a3-d2a2878e1705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3997288-5b3f-4013-bcad-f59ce5f32db3", "name": "network-vif-plugged", "status": "completed", "tag": "dc6ce4e8-3940-405a-82fa-ee8b6d0fd6d3"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:06.236858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:06.236858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:47:06.254135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-bcdb4325-41f9-4c5a-a45d-a516e276c634 req-6c832902-e353-41b9-99a3-d2a2878e1705 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:06.256350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-bcdb4325-41f9-4c5a-a45d-a516e276c634 req-6c832902-e353-41b9-99a3-d2a2878e1705 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:06.303845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-bcdb4325-41f9-4c5a-a45d-a516e276c634 req-6c832902-e353-41b9-99a3-d2a2878e1705 service nova] Creating event network-vif-plugged:dc6ce4e8-3940-405a-82fa-ee8b6d0fd6d3 for instance a3997288-5b3f-4013-bcad-f59ce5f32db3 on hv-cinder-80473 Nov 22 16:47:06.323612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-bcdb4325-41f9-4c5a-a45d-a516e276c634 req-6c832902-e353-41b9-99a3-d2a2878e1705 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092030 Nov 22 16:47:06.324772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 57/99] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:06.573159 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:06.593104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-10b3b283-8c13-4d51-acc7-18655fa5db29 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1501 microversion: 2.1 time: 0.662059 Nov 22 16:47:06.594471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 43/100] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:05 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1501 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:06.893309 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:06.894436 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:06.913426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:06.916190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:06.917795 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:06.919031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:06.936162 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5055853-94c4-4061-8eb2-57aa5b1f3d4a"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:06.938682 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:06.961637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:06.969764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:06.971483 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:06.972294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:07.359650 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:07.375524 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:07.378235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:07.381556 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cad1997d-2050-4317-9ea7-d97cbd4b484a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.491091 Nov 22 16:47:07.382184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 58/101] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:06 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:07.387513 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:07.388225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:07.408342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:07.409174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:07.410810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:07.412394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:07.682416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:07.696962 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a55851d4-196e-4076-9909-1afba94dcc13 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.312963 Nov 22 16:47:07.697857 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 59/102] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:07 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:08.360966 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-a4385d7a-6c2b-4572-9a4c-dcf0bcab2d30 req-6e1eea6f-1d71-4792-803a-ce9917d8b72a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286a87c0-cd89-4f83-8b58-a8ee9f2636b3", "name": "network-vif-plugged", "status": "completed", "tag": "c2cb7311-7775-45f5-a309-0e88da36762b"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:08.363263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:08.363263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:47:08.373574 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-a4385d7a-6c2b-4572-9a4c-dcf0bcab2d30 req-6e1eea6f-1d71-4792-803a-ce9917d8b72a service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:08.374207 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-a4385d7a-6c2b-4572-9a4c-dcf0bcab2d30 req-6e1eea6f-1d71-4792-803a-ce9917d8b72a service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:08.389360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-a4385d7a-6c2b-4572-9a4c-dcf0bcab2d30 req-6e1eea6f-1d71-4792-803a-ce9917d8b72a service nova] Creating event network-vif-plugged:c2cb7311-7775-45f5-a309-0e88da36762b for instance 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 on hv-cinder-80473 Nov 22 16:47:08.397335 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-a4385d7a-6c2b-4572-9a4c-dcf0bcab2d30 req-6e1eea6f-1d71-4792-803a-ce9917d8b72a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040178 Nov 22 16:47:08.403018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 60/103] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:47:08.409259 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:08.422988 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:08.434673 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:08.435142 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:08.435981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:08.436472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:08.636037 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:08.651618 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:08.654864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:08.656353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e0affbff-c10e-4acf-96e0-b26bf28b4cf8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.251474 Nov 22 16:47:08.657187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 61/104] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:08 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:08.725722 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:08.726646 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:08.737769 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:08.738602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:08.740164 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:08.741005 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:08.978302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:08.995206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-37c471e1-ab8e-4991-9194-4b91ebcccc4a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.274020 Nov 22 16:47:08.996682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 62/105] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:08 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:09.688386 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:09.689779 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:09.703017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:09.704085 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:09.705821 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:09.706854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:10.139416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:10.152322 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:10.154357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:10.156446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6123907e-542c-4c0f-9c28-81796ed0994a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.474967 Nov 22 16:47:10.158848 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 63/106] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:09 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:10.165862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:10.167057 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:10.183014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:10.183923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:10.185771 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:10.188577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:10.320350 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bfd12258-96a3-4fc8-8630-f66a1ef1cbc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.390172 Nov 22 16:47:10.348637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 44/107] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:47:06 2021] POST /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments => generated 194 bytes in 3420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:10.583922 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:10.605428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9cf9f1cf-07c4-489c-a497-ec187aa4f32f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.444686 Nov 22 16:47:10.607520 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 64/108] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:10 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:10.617200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01671c14-57dd-4567-956c-dd27cd487e82"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:10.619475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:10.631678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:10.632819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:10.634255 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:10.634974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:11.184817 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:11.185712 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:11.204046 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:11.205677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:11.207349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:11.208309 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:11.450830 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:11.460087 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:11.461708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:11.463382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-76400f98-c420-4361-815b-2acd4f4277b0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.286595 Nov 22 16:47:11.464240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 65/109] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:11 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:11.560100 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-da3bc75b-db20-41a4-8d76-37586b25964a tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "POST /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947397 Nov 22 16:47:11.561884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 45/110] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:47:10 2021] POST /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:11.637132 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:11.638826 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:11.652243 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:11.653034 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:11.655321 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:11.656147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:11.793076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-510b81d2-8616-4a3f-a35c-94cc7336dabc req-e751c46e-8397-41fc-bd34-eb09b6db17bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "name": "network-vif-plugged", "status": "completed", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:11.801136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:11.801136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:47:11.818981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-510b81d2-8616-4a3f-a35c-94cc7336dabc req-e751c46e-8397-41fc-bd34-eb09b6db17bd service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:11.820032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-510b81d2-8616-4a3f-a35c-94cc7336dabc req-e751c46e-8397-41fc-bd34-eb09b6db17bd service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:11.844661 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-510b81d2-8616-4a3f-a35c-94cc7336dabc req-e751c46e-8397-41fc-bd34-eb09b6db17bd service nova] Creating event network-vif-plugged:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:47:11.858304 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-510b81d2-8616-4a3f-a35c-94cc7336dabc req-e751c46e-8397-41fc-bd34-eb09b6db17bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073324 Nov 22 16:47:11.859805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 46/111] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:12.069972 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:12.083751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-be3e5c97-8f5b-4d8d-9c48-6b00c5647461 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1321 microversion: 2.1 time: 0.453943 Nov 22 16:47:12.096326 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 66/112] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:11 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:12.491809 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:12.492959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:12.504024 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:12.505348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:12.507197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:12.507976 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:12.719441 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:12.730780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:12.730780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:12.730780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-83166ec1-b755-41de-8c5d-dad7ae7606de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.245306 Nov 22 16:47:12.731405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 47/113] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:12 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:47:13.105879 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:13.106620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:13.113042 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.113502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.114298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.114909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.338005 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:13.351658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f1856c7a-804b-4800-a270-eaf14b00cf73 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1515 microversion: 2.1 time: 0.251704 Nov 22 16:47:13.353800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 67/114] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:13 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:13.373277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:13.374454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:13.384798 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.385491 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.386949 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.388286 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.492370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lazy-loading 'flavor' on Instance uuid 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:47:13.750455 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:13.750903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-59aaa6c2-28bf-4295-ac73-8c2e2a4b8e6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3/action" status: 200 len: 32 microversion: 2.1 time: 0.381248 Nov 22 16:47:13.751707 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:13.752407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 48/115] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:47:13 2021] POST /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3/action => generated 32 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:47:13.762605 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.763154 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.764211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.764721 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.773817 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:13.775342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:13.796229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.797752 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:13.799599 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:13.800394 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:14.146943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:14.158840 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:14.164291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:14.169027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-352a08e9-6e49-4dbc-a767-5881f7bd9f6a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1407 microversion: 2.20 time: 0.421055 Nov 22 16:47:14.171854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 68/116] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:13 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1407 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:47:14.216505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:14.229217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6517ca14-ad88-4e30-90df-ba697a6d7184 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.464920 Nov 22 16:47:14.243746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 49/117] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:13 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:15.200164 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:15.201346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:15.208546 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:15.208546 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:15.209046 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:15.209467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:15.258090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:15.261875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:15.271189 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:15.271963 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:15.274445 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:15.275336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:15.554691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:15.572012 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:15.573678 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:15.574833 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-29613f9e-189a-4dfc-a10d-429b464ca99e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1599 microversion: 2.20 time: 0.378719 Nov 22 16:47:15.575403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 69/118] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:47:15 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1599 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:47:15.625170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:15.626937 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:15.642839 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:15.645192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:15.646624 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:15.647431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:15.650191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:15.663053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4549f988-648e-458b-98ae-84c89a7e6bb9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.413218 Nov 22 16:47:15.670412 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 50/119] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:15 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:15.815787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c02bca4d-94b7-4419-a20c-7cb78ffcb6a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.195966 Nov 22 16:47:15.817172 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 70/120] 10.222.0.61 () {60 vars in 1315 bytes} [Mon Nov 22 16:47:15 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:47:16.694598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:16.695891 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:16.712875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:16.712875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:16.712875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:16.712875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:17.216666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:17.241658 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a9e55afa-04ef-4d94-b541-8d5da68086df tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.550257 Nov 22 16:47:17.242326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 51/121] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:16 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:18.262844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:18.264851 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:18.290252 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:18.291275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:18.293080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:18.299196 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:18.822511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:18.823420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:18.838482 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:18.838947 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:18.839755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:18.844977 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:18.962401 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:18.985157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-77ef8d5a-8d15-42cb-8d01-ce64010fb3ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.728620 Nov 22 16:47:18.990537 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 71/122] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:18 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:19.011601 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-1ca8e16c-4395-4a58-869d-323f780a4c41 req-fd7a132b-0e7b-463c-95a6-149111d2beef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:19.019442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:19.019442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:47:19.047702 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-1ca8e16c-4395-4a58-869d-323f780a4c41 req-fd7a132b-0e7b-463c-95a6-149111d2beef service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:19.052217 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-1ca8e16c-4395-4a58-869d-323f780a4c41 req-fd7a132b-0e7b-463c-95a6-149111d2beef service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:19.084623 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-1ca8e16c-4395-4a58-869d-323f780a4c41 req-fd7a132b-0e7b-463c-95a6-149111d2beef service nova] Creating event network-changed:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:47:19.101121 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c5949b3d-d032-4933-8c22-c9f27c89ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.281305 Nov 22 16:47:19.103284 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 52/123] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:18 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:19.108264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-1ca8e16c-4395-4a58-869d-323f780a4c41 req-fd7a132b-0e7b-463c-95a6-149111d2beef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115269 Nov 22 16:47:19.109468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 72/124] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:20.023957 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:20.040668 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:20.062933 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:20.066220 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:20.068793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:20.072857 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:20.118054 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:20.120582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:20.138168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:20.160474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:20.162510 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:20.163790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:20.456449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a04ad31a-6607-464d-a714-33908757bc4d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.343770 Nov 22 16:47:20.461683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 73/125] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:20 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:20.542273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:20.553832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-78a84a73-0704-4c81-b731-6522a1137f97 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.538654 Nov 22 16:47:20.555123 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 53/126] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:20 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:20.755725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1908014975", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "45736139-c6d0-4dea-bd82-3ebc3b844a1c"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:20.851125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] validate_networks() for [('45736139-c6d0-4dea-bd82-3ebc3b844a1c', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:47:21.475234 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:21.478590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:21.494125 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:21.495261 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:21.497594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:21.501309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:21.565263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:47:21.565874 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:47:21.566677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:47:21.566677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:47:21.566964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:47:21.591881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:21.593736 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:21.595536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:21.596432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:21.641879 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:47:21.650365 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for user d7fd3afd3c5c48998728927ac2874231 and project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:47:21.662715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c2186ec5-54f4-4c74-a1ea-ae8eab0ce3df tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.196874 Nov 22 16:47:21.668038 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 54/127] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:21 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:21.668274 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:47:21.671116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:47:21.676409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:21.677874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:21.686962 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:21.687749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:21.688817 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:21.689572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:21.734656 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0cb3f6b8-341f-4473-af2c-f000560fc93f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991896 Nov 22 16:47:21.735674 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 74/128] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:47:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:47:21.754681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7fe635c0-4d8c-41bc-8328-e30f82798410 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:21.755409 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7fe635c0-4d8c-41bc-8328-e30f82798410 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:21.925741 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7fe635c0-4d8c-41bc-8328-e30f82798410 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:21.937147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7fe635c0-4d8c-41bc-8328-e30f82798410 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1218 microversion: 2.1 time: 0.192764 Nov 22 16:47:21.949782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 75/129] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:21 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:22.051600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:22.067168 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-44d066c5-2cb9-4450-ae85-b3f4ae57d1d5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.396745 Nov 22 16:47:22.072554 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 55/130] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:21 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:22.678075 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:22.681154 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:22.690234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:22.690942 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:22.692252 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:22.692681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:22.818457 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-77a8fd72-7d28-4470-8968-1a346295859f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.144884 Nov 22 16:47:22.820233 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 76/131] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:22 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:22.973667 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:22.974970 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:22.988604 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:22.989618 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:22.990860 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:22.991794 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:23.090815 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:23.091884 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:23.106911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:23.119659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c7f07f8e-29f1-4a40-a556-50002d23e57c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1270 microversion: 2.1 time: 0.152232 Nov 22 16:47:23.121151 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 56/132] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:22 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:23.126047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:23.127403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:23.129028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:23.130010 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:23.419005 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:23.450018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fec18696-8483-48eb-b88a-80ba0bdfd6a4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.364095 Nov 22 16:47:23.451992 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 77/133] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:23 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:23.833532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:23.834945 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:23.846169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:23.847268 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:23.848209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:23.849091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:23.998185 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cc31bdd6-6504-4986-a684-509e7378812d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.168689 Nov 22 16:47:24.001991 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 57/134] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:23 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:24.153424 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:24.154537 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:24.172003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:24.172968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:24.174526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:24.175608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:24.319129 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:24.337654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-16d984af-bc6c-4266-8a9a-72e6538cd851 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1276 microversion: 2.1 time: 0.190089 Nov 22 16:47:24.340477 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 78/135] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:24 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:24.472773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:24.475895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:24.496793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:24.497944 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:24.501029 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:24.502731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:25.014350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:25.015443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:25.032449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:25.037321 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:25.038502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:25.038664 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:25.102156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:25.121428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4170e379-d77d-4fdc-923d-6df30957da66 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.655502 Nov 22 16:47:25.122771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 58/136] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:24 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:25.214783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2d9edf2e-7a27-4da3-87b3-1326e32eb7af tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.205462 Nov 22 16:47:25.219048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 79/137] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:25 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:25.364873 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:25.366207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:25.391074 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:25.403656 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:25.405517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:25.406110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:25.626486 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:25.638591 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9d491c55-1440-4d7f-bd67-ea642ea0c49b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.279094 Nov 22 16:47:25.648178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 59/138] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:25 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:26.118136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-0d7e4ec4-01d5-41a0-a3a7-ebc877e02397 req-c5b339a9-12ec-4598-8274-9fb71bb0afc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5a9920-9b57-4407-a8ec-81e482c17f40", "tag": "f161f420-b2a8-4508-96f4-093c1147db59"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:26.119877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:26.119877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:47:26.136630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-0d7e4ec4-01d5-41a0-a3a7-ebc877e02397 req-c5b339a9-12ec-4598-8274-9fb71bb0afc5 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.137495 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-0d7e4ec4-01d5-41a0-a3a7-ebc877e02397 req-c5b339a9-12ec-4598-8274-9fb71bb0afc5 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:26.154695 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:26.157730 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:26.170027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-0d7e4ec4-01d5-41a0-a3a7-ebc877e02397 req-c5b339a9-12ec-4598-8274-9fb71bb0afc5 service nova] Creating event network-changed:f161f420-b2a8-4508-96f4-093c1147db59 for instance 5a5a9920-9b57-4407-a8ec-81e482c17f40 on hv-cinder-80473 Nov 22 16:47:26.181413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.184075 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-0d7e4ec4-01d5-41a0-a3a7-ebc877e02397 req-c5b339a9-12ec-4598-8274-9fb71bb0afc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071993 Nov 22 16:47:26.185434 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 80/139] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:47:26.185610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:26.192595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.193879 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:26.232614 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:26.236557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:26.249425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.250279 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:26.251325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.255026 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:26.475560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-04459b30-0b5c-40b7-906a-ade4748c608d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.251832 Nov 22 16:47:26.481590 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 81/140] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:26 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:26.662652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:26.662818 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:26.663513 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:26.684442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3f824157-b22d-46b7-b784-64e3fa56927e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.536277 Nov 22 16:47:26.686682 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 60/141] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:26 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:26.718352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.719890 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:26.720906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:26.721751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.074139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:27.090507 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-795ce187-dc9d-4e01-8f06-ad71fcf66f7f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.433719 Nov 22 16:47:27.091960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 82/142] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:26 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:27.492131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:27.492131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:27.504685 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:27.505955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.505955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:27.506267 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.644193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:27.645120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:27.653190 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0a81b925-19c3-4574-ae3f-2faaf6f85e70 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.167484 Nov 22 16:47:27.656712 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 61/143] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:27 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:27.670816 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:27.671547 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.673204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:27.673958 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.709349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:27.710192 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:27.737116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:47:27.739452 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:27.741554 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.743635 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:27.744514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:27.971120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3406e38f-7291-43b2-a3d1-8c036a73d201 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "DELETE /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 204 len: 0 microversion: 2.1 time: 0.332733 Nov 22 16:47:27.971722 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 83/144] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:47:27 2021] DELETE /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:47:27.994929 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:27.995759 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:28.004333 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:28.005017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:28.006047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:28.006657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:28.186625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:28.209618 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7c1337a7-dbaf-4883-b517-0d873638fd7d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.506365 Nov 22 16:47:28.210510 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 62/145] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:27 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:28.231196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:28.232673 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:28.241497 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:28.242128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:28.243218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:28.243963 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:28.333110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:28.365938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-316d4545-0900-4a48-9d77-50dad48a4f2c tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.386554 Nov 22 16:47:28.390307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 84/146] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:27 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:28.582349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:28.598047 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5f4f571a-24ae-469c-a298-e64322d764b1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.377837 Nov 22 16:47:28.599055 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 63/147] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:28 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:28.667326 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:28.668483 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:28.675074 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:28.675727 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:28.676658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:28.677290 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.245176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:29.246320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:29.255092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:29.255402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.256255 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:29.256700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.484777 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:29.493192 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b102ea6e-c81a-4d9e-a78e-03268f36b9ac tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.255051 Nov 22 16:47:29.494002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 64/148] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:29 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:29.499560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:29.500352 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:29.507124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:29.508046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.510086 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:29.510786 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.676056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:29.690524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-32443fa8-0a7f-4352-b1a8-ffb46df91dd1 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.195197 Nov 22 16:47:29.691131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 65/149] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:29 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:29.695539 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:29.696242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:29.702484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:29.702949 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.703745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:29.704213 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:29.885144 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:29.897619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-71bb9d93-db13-4dd5-b6f9-23083acfd614 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.204596 Nov 22 16:47:29.910587 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 66/150] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:29 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:30.511567 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:30.512329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:30.519445 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:30.520116 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:30.520971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:30.521478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:30.691316 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:30.703701 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ef2ed94b-71ca-4033-86cb-3483a51658a8 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.196058 Nov 22 16:47:30.705036 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 67/151] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:30 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:30.717246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:30.718650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:30.725745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:30.726408 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:30.727227 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:30.727663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:30.872800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9aabc83e-9da5-43c8-9691-e0b75cf223f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 2.211118 Nov 22 16:47:30.873954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 85/152] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:28 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:30.923179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:30.924140 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:30.934427 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:30.936798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:30.937668 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:30.938115 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:30.997394 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:31.006571 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-25960131-64bb-4bab-aebc-2f37d3acae6e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.294380 Nov 22 16:47:31.017156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 68/153] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:30 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:31.138244 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:31.168762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-dde8529d-42e9-4afa-9565-8658053e8332 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.248870 Nov 22 16:47:31.169810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 86/154] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:30 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:31.730147 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:31.731163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:31.737614 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:31.738062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:31.738876 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:31.739348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:31.888858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:31.890848 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:31.905606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:31.905873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:31.907375 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:31.908196 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:31.915897 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:31.933923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9ae9a216-883e-44a1-ac94-6a276569c852 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.208503 Nov 22 16:47:31.937096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 69/155] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:31 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:32.027715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:32.028869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:32.047412 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:32.048045 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:32.049533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:32.050244 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:32.068598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-15c16cb8-2a29-4ad0-9078-852f5d8337aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14 microversion: 2.20 time: 0.186396 Nov 22 16:47:32.074616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 87/156] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:31 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:32.201975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:32.203007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:32.212222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:32.212658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:32.214231 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:32.215517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:32.261927 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:32.282082 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5c177fc8-a511-4f70-b1eb-6c4f7a7c54f5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.260380 Nov 22 16:47:32.306756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 70/157] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:32 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:32.428448 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:32.440237 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ce414ddf-cbca-4524-815d-1695fa1fa1e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.244518 Nov 22 16:47:32.441859 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 88/158] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:32 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:32.966687 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:32.967866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:32.979625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:32.980118 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:32.980922 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:32.981359 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.087024 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:33.089971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:33.100943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:33.101771 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.103343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:33.104097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.172448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:33.182880 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3ad9e400-958b-4315-8e3f-5a5d72863c9a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.223693 Nov 22 16:47:33.183760 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 71/159] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:32 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:33.314042 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:33.314907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:33.322314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:33.322602 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.323550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:33.324309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.508302 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:33.522620 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ede5f5e9-6b57-46d9-9f70-e7d0ac6be70f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.212135 Nov 22 16:47:33.529751 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 72/160] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:33 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:33.536971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:33.540557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:33.546981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:33.547434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.548268 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:33.548707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:33.743386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:33.756384 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f206c662-8ded-49b9-a3e1-81fbc158787d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.230376 Nov 22 16:47:33.757411 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 73/161] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:33 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:34.201862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:34.203034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:34.210973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:34.212237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:34.213489 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:34.214700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:34.395473 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:34.407562 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-eef24656-08da-4055-b1f5-7acb924dd18f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.209378 Nov 22 16:47:34.408882 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 74/162] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:34 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:34.544672 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:34.545826 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:34.553551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:34.553850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:34.554641 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:34.555095 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:34.724550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:34.739499 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b11c354e-92fc-4d3a-aba9-e0191ca65595 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.200550 Nov 22 16:47:34.741218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 75/163] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:34 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:34.780859 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:34.781533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:34.788090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:34.788527 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:34.789430 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:34.789967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:34.981020 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:34.988845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7728c953-4ca6-4508-9996-6723c5b96217 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.211626 Nov 22 16:47:34.989433 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 76/164] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:34 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:35.434828 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:35.435725 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:35.442611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:35.443062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:35.443876 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:35.444323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:35.622419 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:35.637903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-12ed7bc0-07c0-401d-a0f5-510bbb715d9f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.208078 Nov 22 16:47:35.663099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 77/165] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:35 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:35.710939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-93e528b2-783b-4aa9-a331-d683ba4646f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 10009 microversion: 2.20 time: 2.630543 Nov 22 16:47:35.713148 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 89/166] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:33 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 10009 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:35.771178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:35.771178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:35.781103 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:35.781782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:35.784141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:35.784742 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:35.996149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:36.010893 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:36.015360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bdf7a8ba-c0d1-4cde-8d36-196ecc68bcda tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.252823 Nov 22 16:47:36.016420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 78/167] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:35 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:36.020060 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:36.034478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:36.035294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:36.036655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:36.037406 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:36.214579 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:36.223211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ee11d604-c446-4f8f-98ad-fe6be2b65d10 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.220011 Nov 22 16:47:36.223810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 90/168] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:36 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:36.671561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:36.672550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:36.681569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:36.682130 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:36.683018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:36.683532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:36.729573 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:36.731384 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:36.740812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:36.741618 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:36.744047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:36.744894 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:36.892377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:36.894490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9201b999-335c-47ab-b3ea-c7847712c37c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 14890 microversion: 2.20 time: 0.169424 Nov 22 16:47:36.901806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 91/169] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:36 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 14890 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:47:36.907902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-50919342-313c-42da-8a90-374122aff135 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.244609 Nov 22 16:47:36.908562 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 79/170] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:36 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:37.037264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:37.038717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:37.050092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.050540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.051540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.053412 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.240918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:37.241541 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:37.251794 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.252337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:37.257213 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.259878 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.263040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.266088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a9bc3b68-b3a6-4f5c-8234-f98aff08f092 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1553 microversion: 2.1 time: 0.233821 Nov 22 16:47:37.266868 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 92/171] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:37 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:37.473689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:37.485355 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-839b01e2-7967-4d12-bc8e-8c664319b0c0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.248484 Nov 22 16:47:37.494917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 80/172] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:37 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:37.909955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:37.910882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:37.923228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-362e9830-f0a7-413d-9e0a-b4ee0393f723 req-e1780da2-71b1-4d51-bbf3-58c94b203993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c48729-9d12-41e3-a283-8ff2f04f31a3", "name": "network-vif-deleted", "tag": "49146094-041b-4242-89d8-6a39f4cd1968"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:37.924793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.925246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.925896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:37.925896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:47:37.926099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.926555 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.940775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-362e9830-f0a7-413d-9e0a-b4ee0393f723 req-e1780da2-71b1-4d51-bbf3-58c94b203993 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:37.941918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-362e9830-f0a7-413d-9e0a-b4ee0393f723 req-e1780da2-71b1-4d51-bbf3-58c94b203993 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:37.977864 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-362e9830-f0a7-413d-9e0a-b4ee0393f723 req-e1780da2-71b1-4d51-bbf3-58c94b203993 service nova] Creating event network-vif-deleted:49146094-041b-4242-89d8-6a39f4cd1968 for instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 on hv-cinder-80473 Nov 22 16:47:37.989358 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-362e9830-f0a7-413d-9e0a-b4ee0393f723 req-e1780da2-71b1-4d51-bbf3-58c94b203993 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069240 Nov 22 16:47:37.991886 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 81/173] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:47:38.003053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:38.004574 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:38.018439 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:38.019610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:38.021259 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:38.022014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:38.130270 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0135f463-4535-4607-8fd1-128a227db75d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 17629 microversion: 2.20 time: 0.223783 Nov 22 16:47:38.130582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 93/174] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:37 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 17629 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:38.276781 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:38.286860 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b51b700d-22a7-44df-a634-d2ad78b1a6a0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.292661 Nov 22 16:47:38.287305 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:38.287465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 82/175] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:37 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:38.289091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:38.304204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:38.305794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:38.307003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:38.307962 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:38.398461 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:38.409547 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ede2a70b-d8b5-46a4-9b64-4153ecd9ca83 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1345 microversion: 2.1 time: 0.128689 Nov 22 16:47:38.410175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 94/176] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:38 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1345 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:38.521104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:38.521819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:38.529454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:38.529987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:38.530611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:38.531161 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:38.720081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:38.728374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ab353477-5c13-4b87-b974-5e505768f308 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.212206 Nov 22 16:47:38.728966 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 83/177] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:38 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:39.142919 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:39.143857 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:39.150987 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.151431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.152250 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.152673 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.307396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:39.308053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:39.314639 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.315081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.315903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.316493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.480578 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:39.491479 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e3db4bd4-8013-4347-878d-938d5286d229 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.189221 Nov 22 16:47:39.492121 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 84/178] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:39 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:39.497855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:39.498465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:39.504897 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.505348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.506248 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.506761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.580272 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:39.589504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4e9988f7-4fdd-4cff-aa8a-83c9fd8d2841 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1345 microversion: 2.1 time: 0.095097 Nov 22 16:47:39.590360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 85/179] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:39 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:39.747297 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:39.747964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:39.755514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.756007 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.756795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:39.757261 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:39.922868 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:39.931679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-843ac946-f677-45d4-bec5-a84de0ed4f8f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.187929 Nov 22 16:47:39.932290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 86/180] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:39 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:40.515198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:40.516082 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:40.522332 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:40.522775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:40.524424 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:40.524890 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:40.672182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:40.680271 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d81cebed-04cf-451b-bf18-9e5e4e9331cb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.168667 Nov 22 16:47:40.680886 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 87/181] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:40 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:40.685341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:40.685947 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:40.691932 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:40.692377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:40.693159 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:40.693593 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:40.756160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:40.764886 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ebedd46e-6396-40e2-882e-c7268774fee5 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1345 microversion: 2.1 time: 0.083006 Nov 22 16:47:40.765627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 88/182] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:40 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:40.951874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:40.952815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:40.960466 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:40.960939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:40.961736 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:40.962161 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:41.096090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:41.104040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-360cb714-96f5-405f-bd59-05c28a40db58 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.159282 Nov 22 16:47:41.104628 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 89/183] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:40 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:41.580535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3cc7c266-979e-4995-a6b5-efd9ee8e8a62 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 21922 microversion: 2.20 time: 2.441097 Nov 22 16:47:41.582191 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 95/184] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:39 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 21922 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:41.699450 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:41.700194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:41.700537 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-6cea08c7-f517-464a-a67d-0f227814cf15 req-333c765f-3aac-4b9f-977a-1eea0e546d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5a9920-9b57-4407-a8ec-81e482c17f40", "name": "network-vif-plugged", "status": "completed", "tag": "f161f420-b2a8-4508-96f4-093c1147db59"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:41.702686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:41.702686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:47:41.713009 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:41.713009 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:41.713664 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-6cea08c7-f517-464a-a67d-0f227814cf15 req-333c765f-3aac-4b9f-977a-1eea0e546d31 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:41.713664 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-6cea08c7-f517-464a-a67d-0f227814cf15 req-333c765f-3aac-4b9f-977a-1eea0e546d31 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:41.716360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:41.717242 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:41.742576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-6cea08c7-f517-464a-a67d-0f227814cf15 req-333c765f-3aac-4b9f-977a-1eea0e546d31 service nova] Creating event network-vif-plugged:f161f420-b2a8-4508-96f4-093c1147db59 for instance 5a5a9920-9b57-4407-a8ec-81e482c17f40 on hv-cinder-80473 Nov 22 16:47:41.751700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-6cea08c7-f517-464a-a67d-0f227814cf15 req-333c765f-3aac-4b9f-977a-1eea0e546d31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056014 Nov 22 16:47:41.753327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 90/185] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:41.787760 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:41.789047 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:41.800532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:41.801739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:41.803228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:41.804191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:41.891524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:41.902003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-12e52038-3114-46b7-88af-41849dac394e tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1345 microversion: 2.1 time: 0.121307 Nov 22 16:47:41.903104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 91/186] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:41 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:41.933097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:41.941797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f02536fa-cb74-400d-830b-026867c84858 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.246562 Nov 22 16:47:41.942788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 96/187] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:41 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:42.120452 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:42.121063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:42.128495 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.128944 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.129726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.130158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.308071 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:42.315756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7f9047f2-d701-43ac-a0d0-c2362c24d2cf tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.199269 Nov 22 16:47:42.316672 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 92/188] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:42 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:42.594829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:42.596270 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:42.606950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.607463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.608431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.608829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.767371 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9dc01a19-00df-4c7c-9ac9-17014c98ab0b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 22878 microversion: 2.20 time: 0.176823 Nov 22 16:47:42.768337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 97/189] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:42 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 22878 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:42.923535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:42.926774 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:42.934717 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.935169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.936241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.936676 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.962124 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:42.963581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:42.971885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.972336 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.973125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.973551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.984298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:42.985198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:42.986014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lazy-loading 'fault' on Instance uuid 54c48729-9d12-41e3-a283-8ff2f04f31a3 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:47:43.081064 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fa66795ff3b42759516442170945780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc8e92d816164073980e4b6e167dfcf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:43.102081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-85105cd9-e450-4095-b30e-d108c8e5949d tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 200 len: 1350 microversion: 2.1 time: 0.173574 Nov 22 16:47:43.103013 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 93/190] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:42 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 1350 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:43.276559 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:43.286787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-65de41d2-91e0-4e77-9aaa-6990eb18c1f1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.329191 Nov 22 16:47:43.287551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 98/191] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:42 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:43.343432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:43.344520 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:43.355577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:43.356519 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:43.358164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:43.358995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:43.634956 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:43.646706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a58246f7-6da5-43fc-b44e-58e8fc43ad03 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1318 microversion: 2.1 time: 0.307564 Nov 22 16:47:43.648181 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 94/192] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:43 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:43.783251 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:43.785861 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:43.796403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:43.796898 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:43.798246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:43.798983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:43.959883 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b1d557d0-1d5d-485a-a34c-e81381717936 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 23583 microversion: 2.20 time: 0.182360 Nov 22 16:47:43.960519 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 99/193] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:43 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 23583 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:44.109876 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:44.110811 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:44.118539 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.119282 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.120530 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.121057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.137575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] HTTP exception thrown: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. Nov 22 16:47:44.138177 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Returning 404 to user: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:47:44.139077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-81307e19-487a-450e-b453-1e304d57b9ed tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 404 len: 111 microversion: 2.1 time: 0.033019 Nov 22 16:47:44.139570 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 95/194] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:44 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:47:44.302707 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:44.304082 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:44.313396 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.314116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.315226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.315375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:44.315669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.316691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:44.333612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.334129 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.334951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.335607 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.342116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] HTTP exception thrown: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. Nov 22 16:47:44.343192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Returning 404 to user: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:47:44.344748 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a9a0baf0-e549-45cd-a8be-242f2a02ca7f tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046715 Nov 22 16:47:44.345733 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 100/195] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:47:44 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 16:47:44.566443 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:44.582048 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-61868956-1f47-40d3-bb69-860fc5857472 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.274602 Nov 22 16:47:44.583309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 96/196] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:44 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:44.672813 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:44.677971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:44.686695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.687486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.688604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.689328 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.876586 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:44.888961 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-72ced3d4-8b28-4326-a9d4-38816573ee02 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1507 microversion: 2.1 time: 0.226910 Nov 22 16:47:44.889717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 101/197] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:44 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:44.910380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5055853-94c4-4061-8eb2-57aa5b1f3d4a"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:44.911792 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:44.921349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.921964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.922971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.923543 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.981543 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:44.983280 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:44.991539 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.992767 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:44.994651 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:44.995307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.078934 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] HTTP exception thrown: Invalid volume: volume e5055853-94c4-4061-8eb2-57aa5b1f3d4a is already attached to instances: 46aaa1f5-cd61-46b1-9424-8444b96c948e Nov 22 16:47:45.079538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Returning 400 to user: Invalid volume: volume e5055853-94c4-4061-8eb2-57aa5b1f3d4a is already attached to instances: 46aaa1f5-cd61-46b1-9424-8444b96c948e {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:47:45.080426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d807e2ae-51ea-40bf-9415-8bc5df350c93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.174688 Nov 22 16:47:45.081005 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 97/198] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:47:44 2021] POST /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40/os-volume_attachments => generated 174 bytes in 176 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 16:47:45.161973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:45.162940 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:45.174718 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:45.175497 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.176960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:45.177484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.360396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'services' on Instance uuid 46aaa1f5-cd61-46b1-9424-8444b96c948e {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:47:45.490506 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5cb5755c-230e-4117-b56d-cdce7443367e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments/e5055853-94c4-4061-8eb2-57aa5b1f3d4a" status: 202 len: 0 microversion: 2.1 time: 0.334327 Nov 22 16:47:45.491109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 98/199] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:47:45 2021] DELETE /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments/e5055853-94c4-4061-8eb2-57aa5b1f3d4a => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:45.500511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:45.501652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:45.509023 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:45.509604 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.510713 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:45.511289 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.548992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-40583104-e359-4b60-8f36-0604adff81e1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052644 Nov 22 16:47:45.549503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 99/200] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:47:45 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:47:45.608892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:45.609515 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:45.616567 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:45.617018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.618231 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:45.618768 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:45.802804 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:45.815689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0bcd3494-ab7f-44ee-b441-f3e1265ef945 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.210451 Nov 22 16:47:45.816730 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 100/201] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:45 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:46.561648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:46.562990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:46.571014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:46.571558 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:46.572548 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:46.572987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:46.606964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e22ea53d-9f79-4fd4-8a7e-00e4e759fe4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049630 Nov 22 16:47:46.607536 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 101/202] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:47:46 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:47:46.834506 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:46.835198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:46.842359 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:46.842811 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:46.844014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:46.844455 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:46.999263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:47.007312 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-89e224d8-a43e-47a7-8a98-87e01728d9ed tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.176431 Nov 22 16:47:47.008451 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 102/203] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:46 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:47.621108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:47.621971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:47.629344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:47.629855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:47.630701 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:47.631387 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:47.671061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-01a47a28-2da0-4780-84b4-747a913f4831 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056233 Nov 22 16:47:47.671621 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 103/204] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:47:47 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:47.709473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f4b2cb60-fa3c-46ca-aa72-17046ae0e36e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 26800 microversion: 2.20 time: 2.733484 Nov 22 16:47:47.710106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 102/205] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:44 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 26800 bytes in 2735 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:47:48.028551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:48.030704 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:48.036721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:48.037195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:48.037981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:48.038421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:48.194076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:48.202383 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cb02e1d5-1a54-434a-b624-086743279096 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.180757 Nov 22 16:47:48.202968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 104/206] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:48 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:48.686870 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:48.687930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:48.694734 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:48.695175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:48.696575 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:48.696994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:48.721871 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:48.722830 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:48.731460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:48.732082 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:48.732887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:48.733330 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:48.740909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2f7ed969-48b1-4405-9880-e90eaac44fa3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058309 Nov 22 16:47:48.741890 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 103/207] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:47:48 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:47:48.869419 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-aef26e38-2473-4d3a-8ea7-ff996c02472c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 27170 microversion: 2.20 time: 0.150844 Nov 22 16:47:48.870534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 105/208] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:48 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 27170 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:47:49.225207 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:49.227226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:49.238036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.238603 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.239655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.240036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.474028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:49.485455 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fa711c22-ddbe-424d-9e01-391cd5fc503b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.267531 Nov 22 16:47:49.486446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 104/209] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:49 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:49.762202 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:49.763241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:49.769967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.770403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.771189 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.771621 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.805930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8c896397-906d-47bb-9f01-c11206c4caaa tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053276 Nov 22 16:47:49.806511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 106/210] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:47:49 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:47:49.886473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:49.888895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:49.905109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.906119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.908212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.914389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:49.915253 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:49.920549 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.924540 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.926219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.928677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.929197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.964262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] HTTP exception thrown: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. Nov 22 16:47:49.965398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Returning 404 to user: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:47:49.966662 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-fad619f1-8618-4e47-9d74-044e217214fe tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "DELETE /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 404 len: 111 microversion: 2.1 time: 0.056629 Nov 22 16:47:49.968650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 107/211] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:47:49 2021] DELETE /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:47:49.978356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:49.978983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] [instance: 54c48729-9d12-41e3-a283-8ff2f04f31a3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:49.996678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.997034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:49.998016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:49.998618 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:50.014018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] HTTP exception thrown: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. Nov 22 16:47:50.014652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] Returning 404 to user: Instance 54c48729-9d12-41e3-a283-8ff2f04f31a3 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:47:50.015494 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-014e0a26-927d-4971-a955-e6be3d1d9121 tempest-DeleteServersTestJSON-1393580801 tempest-DeleteServersTestJSON-1393580801-project] 10.222.0.61 "GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3" status: 404 len: 111 microversion: 2.1 time: 0.042104 Nov 22 16:47:50.016393 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 108/212] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:49 2021] GET /compute/v2.1/servers/54c48729-9d12-41e3-a283-8ff2f04f31a3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:47:50.071983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-249570516", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "45736139-c6d0-4dea-bd82-3ebc3b844a1c"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:50.119916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3371cc94-cfae-4212-81e8-e50a7b192bf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 27617 microversion: 2.20 time: 0.239689 Nov 22 16:47:50.121157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 105/213] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:49 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 27617 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:50.147017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] validate_networks() for [('45736139-c6d0-4dea-bd82-3ebc3b844a1c', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:47:50.519123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:50.521951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:50.546230 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:50.547139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:50.548415 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:50.549408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:50.874271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:50.883571 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a44a6970-aaaf-4497-9708-135eff280cbf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.373759 Nov 22 16:47:50.894612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 106/214] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:50 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:50.941666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:47:50.942528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:47:50.943462 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:47:50.944260 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:47:50.945209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:47:50.964361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:50.965096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:50.966890 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:50.967930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:51.005001 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:47:51.011761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for user d7fd3afd3c5c48998728927ac2874231 and project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:47:51.027498 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:47:51.030585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:47:51.125486 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f86aaff9-09fe-4f72-8bd0-c7f2b4ffea4e tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.058256 Nov 22 16:47:51.139962 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 109/215] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:47:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 16:47:51.140596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:51.141795 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:51.148435 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c90c406d-1a75-4091-9ca5-5c254589ae93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:51.149841 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c90c406d-1a75-4091-9ca5-5c254589ae93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:51.156301 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:51.156777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:51.159391 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:51.160861 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:51.230385 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c90c406d-1a75-4091-9ca5-5c254589ae93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:51.238854 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c90c406d-1a75-4091-9ca5-5c254589ae93 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1217 microversion: 2.1 time: 0.096580 Nov 22 16:47:51.239442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 110/216] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:51 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:51.903717 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:51.904508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:51.911086 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:51.911534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:51.912762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:51.913268 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:52.299934 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:52.309235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bf1db424-bb4a-4b6c-bb1c-c014bc751143 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.409320 Nov 22 16:47:52.309828 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 111/217] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:51 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:52.314727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:52.315444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:52.322964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:52.323651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:52.324526 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:52.324959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:52.395719 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:52.407550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-694b0cc3-9d6a-4e82-be69-a9a03ffb466b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1221 microversion: 2.1 time: 0.096114 Nov 22 16:47:52.409747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 112/218] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:52 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:53.328004 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:53.328971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:53.335191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:53.335753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:53.336793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:53.337565 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:53.557451 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:53.574170 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8dd0ed88-1b64-4b57-89c3-65e6b19ce2fa tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.249804 Nov 22 16:47:53.575144 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 113/219] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:53 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:53.591792 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:53.592741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:53.622575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:53.623425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:53.624301 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:53.624789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:53.745076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:53.760389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-279e2a6b-2bcc-46dd-ba4a-43f711dde917 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1221 microversion: 2.1 time: 0.181543 Nov 22 16:47:53.760389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 114/220] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:53 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1221 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:54.045910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-005d942b-572a-4001-9356-b90a2b0bc752 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 27868 microversion: 2.20 time: 2.910943 Nov 22 16:47:54.054153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 107/221] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:51 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 27868 bytes in 2921 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:54.594483 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:54.595460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:54.604095 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:54.604513 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:54.605693 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:54.606132 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:54.783716 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:54.784654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:54.797489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:54.798097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:54.799081 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:54.799518 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:54.803572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:54.832943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f72f2f94-bab3-4aa5-b30e-79864f4fffbc tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.244024 Nov 22 16:47:54.833554 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 115/222] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:54 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:54.901704 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:54.911314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6acb20a8-a5a7-4581-ac3a-958d645510a8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1269 microversion: 2.1 time: 0.135137 Nov 22 16:47:54.923860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 108/223] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:54 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:55.069361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:55.070508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:55.079291 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:55.079941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:55.080835 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:55.081341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:55.244608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f9d99402-2c92-4116-be66-96f5cb3f11cb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28158 microversion: 2.20 time: 0.180981 Nov 22 16:47:55.245336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 116/224] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:55 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28158 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:55.864488 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:55.865796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:55.876733 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:55.878204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:55.879242 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:55.879966 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:55.946370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:55.948017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:55.963188 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:55.968814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:55.969782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:55.970293 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:56.318211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:56.332231 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-87c23579-94b9-4970-816f-5573e56f1b62 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.478149 Nov 22 16:47:56.332741 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 109/225] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:55 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:56.348853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2066420840", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "790b6599-ac85-430c-a04c-ca0ad620f7a7"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:56.367152 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:56.376258 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e78ba3c8-edc5-4c26-8e4b-32d01f00f7d0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.435275 Nov 22 16:47:56.386389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 117/226] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:55 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:56.386389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:56.386597 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:56.394605 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:56.395328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:56.396571 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:56.397652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:56.432759 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] validate_networks() for [('790b6599-ac85-430c-a04c-ca0ad620f7a7', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:47:56.544178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-275a2087-e62e-4ebd-8a47-14a3a69529b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28158 microversion: 2.20 time: 0.160179 Nov 22 16:47:56.545320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 118/227] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:56 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28158 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:57.013905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:47:57.014376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:47:57.014815 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:47:57.015218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:47:57.016360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:47:57.028735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.029607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.030479 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.030869 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.064844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Getting quotas for project d53fc1c502384324bad19d3be7486258. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:47:57.072328 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Getting quotas for user aeefa547696c40f7bbd0b632ff08d60a and project d53fc1c502384324bad19d3be7486258. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:47:57.095994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:47:57.102357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:47:57.148032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-2045b16d-18dc-4b19-b7ba-6e2b7874743f req-17a141c0-6a7e-4638-8649-5978c59a107e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc3b870-6198-463e-8ee9-b68bbb652e52", "tag": "6262f34a-c749-4312-89ee-7e9ab39991c8"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:57.149845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:47:57.149845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:47:57.182777 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-2045b16d-18dc-4b19-b7ba-6e2b7874743f req-17a141c0-6a7e-4638-8649-5978c59a107e service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.183575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-2045b16d-18dc-4b19-b7ba-6e2b7874743f req-17a141c0-6a7e-4638-8649-5978c59a107e service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.200226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cde5b808-133c-4861-a384-c6297a175b48 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857332 Nov 22 16:47:57.201208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 110/228] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:47:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:47:57.205813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-2045b16d-18dc-4b19-b7ba-6e2b7874743f req-17a141c0-6a7e-4638-8649-5978c59a107e service nova] Creating event network-changed:6262f34a-c749-4312-89ee-7e9ab39991c8 for instance 9dc3b870-6198-463e-8ee9-b68bbb652e52 on hv-cinder-80473 Nov 22 16:47:57.211177 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-2045b16d-18dc-4b19-b7ba-6e2b7874743f req-17a141c0-6a7e-4638-8649-5978c59a107e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086391 Nov 22 16:47:57.212241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 119/229] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:47:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:47:57.215031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f055fa42-fb7a-470f-9054-76f694200c6b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:57.215807 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f055fa42-fb7a-470f-9054-76f694200c6b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:57.352217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:57.352913 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:57.369064 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f055fa42-fb7a-470f-9054-76f694200c6b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:57.374988 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.376176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.377101 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.378931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.386977 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f055fa42-fb7a-470f-9054-76f694200c6b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1214 microversion: 2.1 time: 0.176868 Nov 22 16:47:57.388757 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 111/230] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:57 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1214 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:57.397569 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:57.399660 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:57.456776 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.457627 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.458275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.458789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.702863 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:57.715299 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-65960ef5-4bbe-4375-a05f-8282c33f907f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.367747 Nov 22 16:47:57.716183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 120/231] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:57 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:57.721270 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:57.722132 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:57.744836 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.746481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.750278 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:57.753716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:57.850946 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:57.878278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c0a62080-a390-425f-8a08-7ae0fe1f2881 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.488002 Nov 22 16:47:57.879308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 112/232] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:57 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:57.938393 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8b498a54-dd38-4a21-a53e-223004013633 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28449 microversion: 2.20 time: 0.220725 Nov 22 16:47:57.939591 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 121/233] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:57 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28449 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:58.407012 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:58.407937 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:58.414861 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:58.415304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:58.416264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:58.417074 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:58.489354 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:58.515400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-59249253-cb6b-41e3-bbf7-2d7fa34793aa tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1266 microversion: 2.1 time: 0.101159 Nov 22 16:47:58.515400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 113/234] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:58 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:47:58.746733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:58.749109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:58.763969 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:58.764844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:58.765845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:58.766801 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:58.899358 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:58.900425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:58.925472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:58.925863 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:58.927394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:58.928240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:58.997334 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:59.011610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e9fad9cf-9dcb-4006-aca1-2cdb78d24402 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.274141 Nov 22 16:47:59.012736 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 122/235] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:58 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:59.019105 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:47:59.020470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:59.036694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:59.037652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:59.040434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:59.042716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:59.217104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3fbf64d0-3f18-4494-b081-5b964c7ccc9b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28449 microversion: 2.20 time: 0.202211 Nov 22 16:47:59.224428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 123/236] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:47:59 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28449 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:47:59.301605 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:59.313213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d776c157-b3a0-4a81-98ff-0497ec79d508 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.417842 Nov 22 16:47:59.325306 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 114/237] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:58 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:47:59.523648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:47:59.524637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:47:59.534609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:59.535480 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:59.537157 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:47:59.538282 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:47:59.651155 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:47:59.659395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2c91cefb-94e4-438d-bfec-0e2d7b2ed056 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1272 microversion: 2.1 time: 0.140168 Nov 22 16:47:59.671690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 124/238] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:47:59 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:00.030901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:00.032267 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:00.042768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.043354 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.048480 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.052611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.235643 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:00.235643 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:00.247280 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.247811 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.248691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.249124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.520052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:00.528891 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a145bf09-02f0-464e-b552-0abfc9fb2a9c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.501591 Nov 22 16:48:00.529277 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 115/239] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:00 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:00.534897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:00.535497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:00.543341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.544076 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.545032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.545620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.835214 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:00.849970 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b4983e56-4782-46ef-97a0-ff1f23a62591 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.318836 Nov 22 16:48:00.850902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 116/240] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:00 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:00.856297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:00.857263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:00.866293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.866756 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:00.867843 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:00.868464 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:01.096946 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:01.123453 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-53a435e4-3f35-4b49-8c68-27e8d0746640 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.270874 Nov 22 16:48:01.124539 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 117/241] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:00 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:01.555099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:01.556252 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:01.567394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:01.567566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:01.568736 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:01.569231 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:01.774588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:01.785535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-554c598a-6a11-4b66-ac22-e67229c39882 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.237987 Nov 22 16:48:01.787038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 118/242] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:01 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:01.871123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:01.872366 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:01.878893 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:01.879341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:01.880177 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:01.880752 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:02.114282 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:02.124567 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-916a7e04-2b9b-46b2-8015-b5ff592bce01 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.259585 Nov 22 16:48:02.125844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 119/243] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:01 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:02.156009 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:02.157526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:02.171914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:02.172558 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:02.173507 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:02.174581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:02.380799 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:02.391053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-68e1ce9b-a701-4c68-89cd-dae2912069ee tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.243241 Nov 22 16:48:02.395927 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 120/244] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:02 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:02.813554 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:02.814315 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:02.823999 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:02.825107 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:02.826517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:02.827303 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:03.039384 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:03.054102 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6e748da6-b037-43e7-ae95-b5c8c9bb3113 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.244826 Nov 22 16:48:03.064872 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 121/245] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:02 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:03.145126 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:03.145996 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:03.154894 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:03.155505 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:03.157330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:03.158304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:03.375793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:03.388529 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cd5a597d-5a3a-490d-b35a-a3b6438feb5c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.248256 Nov 22 16:48:03.389679 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 122/246] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:03 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:03.410857 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:03.411698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:03.419865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:03.420645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:03.421761 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:03.422462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:03.709931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:03.718145 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f82aac90-bf8a-41b6-884f-1c262446d8c9 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.311812 Nov 22 16:48:03.718726 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 123/247] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:03 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:03.856142 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b7214384-9785-4ecf-8e1b-abb9d8498c4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 3.627240 Nov 22 16:48:03.857020 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 125/248] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:00 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 3631 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:04.078320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:04.079082 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:04.085431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:04.086913 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:04.087982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:04.088916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:04.344800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:04.357254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ccaeabe5-440e-435a-9f87-c72bf7c5b05d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1521 microversion: 2.1 time: 0.279657 Nov 22 16:48:04.357254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 124/249] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:04 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:04.420091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:04.421565 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:04.452485 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:04.453103 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:04.455128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:04.455716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:04.741766 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:04.743123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:04.779296 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:04.781342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:04.787137 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:04.803144 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.050261 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:05.076113 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bb9d0fe4-925b-4c76-b988-89be00effb62 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.668089 Nov 22 16:48:05.077447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 126/250] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:04 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:05.098098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:05.113586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:05.141013 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.148079 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.151065 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.153458 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.199234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:05.221062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d81b0ac5-d58a-4ea6-974c-ae262635bc0b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.487010 Nov 22 16:48:05.221800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 125/251] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:04 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:05.227166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-6b671fc0-106c-4a2e-8b09-d5141fb1b364 req-ac89f43e-b8c0-452a-8e36-a7fc021187ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6da55b-1db7-41e9-b7ba-9a441494005f", "tag": "a4e9ec81-9ed8-4c20-a1e7-57374d3f9e90"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:05.229212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:05.229212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:48:05.237675 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-6b671fc0-106c-4a2e-8b09-d5141fb1b364 req-ac89f43e-b8c0-452a-8e36-a7fc021187ca service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.238487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-6b671fc0-106c-4a2e-8b09-d5141fb1b364 req-ac89f43e-b8c0-452a-8e36-a7fc021187ca service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.252479 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-6b671fc0-106c-4a2e-8b09-d5141fb1b364 req-ac89f43e-b8c0-452a-8e36-a7fc021187ca service nova] Creating event network-changed:a4e9ec81-9ed8-4c20-a1e7-57374d3f9e90 for instance 7f6da55b-1db7-41e9-b7ba-9a441494005f on hv-cinder-80473 Nov 22 16:48:05.258316 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-6b671fc0-106c-4a2e-8b09-d5141fb1b364 req-ac89f43e-b8c0-452a-8e36-a7fc021187ca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034572 Nov 22 16:48:05.259262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 126/252] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:05.331055 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-85079f05-f1a1-48ed-b101-39e3d982bd5e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.239735 Nov 22 16:48:05.331871 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 127/253] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:05 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:05.375885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:05.377782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:05.389141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.390409 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.392239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.393307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.729358 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:05.735557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-b76e66bb-56f9-46cf-9e41-407212699b4e req-50888d8f-53d9-4bff-9b4f-5ce34d997ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc3b870-6198-463e-8ee9-b68bbb652e52", "name": "network-vif-plugged", "status": "completed", "tag": "6262f34a-c749-4312-89ee-7e9ab39991c8"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:05.738694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:05.738694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:48:05.749167 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d2b3538a-08b5-48aa-afac-63f532faf8e0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1501 microversion: 2.1 time: 0.379823 Nov 22 16:48:05.750812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 127/254] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:05 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1501 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:05.769739 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:05.771487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-b76e66bb-56f9-46cf-9e41-407212699b4e req-50888d8f-53d9-4bff-9b4f-5ce34d997ea9 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.772331 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-b76e66bb-56f9-46cf-9e41-407212699b4e req-50888d8f-53d9-4bff-9b4f-5ce34d997ea9 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.774537 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:05.790917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.791729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.795078 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:05.798186 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:05.823487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-b76e66bb-56f9-46cf-9e41-407212699b4e req-50888d8f-53d9-4bff-9b4f-5ce34d997ea9 service nova] Creating event network-vif-plugged:6262f34a-c749-4312-89ee-7e9ab39991c8 for instance 9dc3b870-6198-463e-8ee9-b68bbb652e52 on hv-cinder-80473 Nov 22 16:48:05.840442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-b76e66bb-56f9-46cf-9e41-407212699b4e req-50888d8f-53d9-4bff-9b4f-5ce34d997ea9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116218 Nov 22 16:48:05.841477 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 128/255] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:06.055608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:06.067380 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-08f2db90-0418-462c-ad89-626cff57cb79 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1516 microversion: 2.1 time: 0.303646 Nov 22 16:48:06.069517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 128/256] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:05 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:06.109774 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:06.110981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:06.121760 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:06.122235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:06.123405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:06.124099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:06.241344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:06.242868 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:06.265631 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:06.267693 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:06.268726 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:06.269264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:06.363217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:06.374095 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a0da752b-688f-40f2-bdc4-80bd7e0c1e60 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.281804 Nov 22 16:48:06.374669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 129/257] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:06 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:06.393844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:06.398141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:06.411027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:06.411753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:06.412955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:06.414127 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:06.556482 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-29e3fa2c-ef19-46a0-b8b7-a1d754c10732 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.170837 Nov 22 16:48:06.561230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 130/258] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:06 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:06.584895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:06.602557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c1ddd78a-b55c-4f6c-9918-904435bc89be tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.365094 Nov 22 16:48:06.603978 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 129/259] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:06 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:07.404799 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:07.405754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:07.416428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.417166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.418461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.419179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.568441 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:07.569553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:07.583278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.583733 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.584876 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.586937 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.611987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:07.619793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-83f329db-cce0-4395-9d0d-9b344b2b8586 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1317 microversion: 2.1 time: 0.220352 Nov 22 16:48:07.620990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 131/260] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:07 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:07.625645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:07.626256 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:07.634303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.634742 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.635870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.636289 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.755777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5a15f889-5b5f-4964-8a29-78e9c32d8d4b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.189825 Nov 22 16:48:07.756960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 130/261] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:07 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:07.784986 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:07.794650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-af49d4a4-0462-4411-b7cd-7d936fa7e007 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.172569 Nov 22 16:48:07.795241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 132/262] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:07 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:07.847580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:07.849179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:07.860508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.861082 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.861936 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:07.862502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:07.899374 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lazy-loading 'flavor' on Instance uuid a3997288-5b3f-4013-bcad-f59ce5f32db3 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:48:08.026139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d1a7f66a-5826-44de-9184-5898da243b8f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action" status: 200 len: 32 microversion: 2.1 time: 0.185248 Nov 22 16:48:08.026746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 131/263] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:48:07 2021] POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 16:48:08.036558 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:08.037234 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:08.044385 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.044833 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.045899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.046099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.188001 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:08.196323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e8433887-0417-4229-abad-c407ceb2e954 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.163933 Nov 22 16:48:08.196910 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 133/264] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:08 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:08.638901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:08.639486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:08.646126 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.646573 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.647475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.648098 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.771429 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:08.772456 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:08.784792 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.785301 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.786108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.786738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.810284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:08.821680 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aa71232b-85fe-4c4f-afc0-13c3e94a687f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1507 microversion: 2.1 time: 0.187200 Nov 22 16:48:08.822266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 132/265] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:08 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:08.838364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:08.839597 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:08.848040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.848497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.849335 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:08.849773 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:08.939845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4f6a0da9-d064-4882-93cd-e77766abd4fb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.171573 Nov 22 16:48:08.943027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 134/266] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:08 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:48:09.071684 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:09.086263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-83ec9609-8fe8-4051-8c2e-ea30add52f52 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.262494 Nov 22 16:48:09.087325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 133/267] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:08 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:09.218950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:09.220493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:09.228613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:09.229067 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:09.229856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:09.230292 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:09.411144 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:09.419810 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ffdced30-2755-4d65-b326-98f91cd09b9b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.209316 Nov 22 16:48:09.420405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 135/268] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:09 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:09.956661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:09.958523 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:09.966699 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:09.967178 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:09.968003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:09.968495 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.106428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:10.107262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:10.114548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-16fd4c0d-9089-40f3-a2b6-2a804ca536e6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.163208 Nov 22 16:48:10.119060 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:10.119514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.120340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:10.120772 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.121766 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 134/269] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:09 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:10.262038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9b8b0b5-bc04-4d49-add1-a9dd00057971"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:10.263322 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:10.269785 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:10.270400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.271202 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:10.271629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.370507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:10.398791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a59de335-bd72-4650-b288-01d5d3a72157 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.295218 Nov 22 16:48:10.399901 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 136/270] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:10 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:10.441939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:10.443252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:10.458129 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:10.460012 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.461592 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:10.462567 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:10.743275 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:10.756179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-12cd4d31-89bd-4a3e-a787-75ca6a819e68 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.320321 Nov 22 16:48:10.756925 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 137/271] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:10 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:10.790156 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-de169ee9-f95e-49f1-9b54-2c966528176b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533046 Nov 22 16:48:10.790993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 135/272] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:48:10 2021] POST /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:48:11.132543 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:11.135026 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:11.146013 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:11.147528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:11.149931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:11.151083 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:11.307628 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-17ab1acc-7d17-401b-8855-17c8bfdad791 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.181255 Nov 22 16:48:11.308974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 138/273] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:11 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:11.422163 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:11.422868 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:11.432368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:11.433022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:11.434013 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:11.434653 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:11.618118 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:11.626213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-03597755-f612-4729-a0ff-82bca6db7698 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.208020 Nov 22 16:48:11.626796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 136/274] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:11 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:11.777308 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:11.777975 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:11.785149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:11.785599 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:11.786406 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:11.786854 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:11.971948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:11.994974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cfb337f5-2d64-4322-a75e-815d1f619105 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.215296 Nov 22 16:48:11.997902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 139/275] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:11 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:12.326784 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:12.328476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:12.339563 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:12.340383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:12.340815 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:12.341246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:12.474197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b732ad44-556a-44aa-8024-c445aa46ca67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.153823 Nov 22 16:48:12.475269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 137/276] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:12 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:12.645613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:12.646259 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:12.653569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:12.654097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:12.654956 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:12.655450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:12.829610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:12.837664 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8987dd63-cb70-4978-be3f-ccdf22e5b10b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.195906 Nov 22 16:48:12.838235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 140/277] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:12 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:13.016903 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:13.017830 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:13.027403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.028128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:13.029254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.029963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:13.225123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:13.236626 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-51b1726e-1061-4cf3-9424-4154763233b3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.224138 Nov 22 16:48:13.237294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 138/278] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:13 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:13.491378 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:13.492951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:13.501391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.502094 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:13.503650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.504398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:13.647010 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-99dc8d7d-a0e6-4895-a630-f60e0735149e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 0.160202 Nov 22 16:48:13.657242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 141/279] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:13 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:13.753839 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-05a1b8ff-a1fe-45d8-bbec-90ba9496c559 req-8a013051-9a6b-4db7-a573-66a7fb4db971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6da55b-1db7-41e9-b7ba-9a441494005f", "name": "network-vif-plugged", "status": "completed", "tag": "a4e9ec81-9ed8-4c20-a1e7-57374d3f9e90"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:13.755486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:13.755486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:48:13.763923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-05a1b8ff-a1fe-45d8-bbec-90ba9496c559 req-8a013051-9a6b-4db7-a573-66a7fb4db971 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.764315 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-05a1b8ff-a1fe-45d8-bbec-90ba9496c559 req-8a013051-9a6b-4db7-a573-66a7fb4db971 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:13.780550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-05a1b8ff-a1fe-45d8-bbec-90ba9496c559 req-8a013051-9a6b-4db7-a573-66a7fb4db971 service nova] Creating event network-vif-plugged:a4e9ec81-9ed8-4c20-a1e7-57374d3f9e90 for instance 7f6da55b-1db7-41e9-b7ba-9a441494005f on hv-cinder-80473 Nov 22 16:48:13.787551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-05a1b8ff-a1fe-45d8-bbec-90ba9496c559 req-8a013051-9a6b-4db7-a573-66a7fb4db971 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038509 Nov 22 16:48:13.788942 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 139/280] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:13.871942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:13.873111 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:13.901363 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.902426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:13.903725 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:13.904723 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:14.153174 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:14.172314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ddbc5a32-7744-48ff-88e7-49a9b657b9bb tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.311276 Nov 22 16:48:14.173027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 142/281] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:13 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:14.256000 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:14.256718 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:14.265036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:14.265493 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:14.266304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:14.266742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:14.440268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:14.449283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d64ee3cd-febe-4ac5-8468-0333da8c84d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.197642 Nov 22 16:48:14.449886 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 140/282] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:14 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:14.714929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:14.716549 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:14.727027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:14.727684 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:14.728953 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:14.729657 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:15.191245 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:15.192111 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:15.200249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:15.200689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:15.201487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:15.201914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:15.375090 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:15.383133 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a2554717-01c4-40f3-b14c-4d31b51d326a tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.196058 Nov 22 16:48:15.383708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 141/283] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:15 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:15.467072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:15.467787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:15.474135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:15.474629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:15.475463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:15.476193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:15.630488 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:15.640359 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2fd3dbd5-864e-4c70-8040-5069ab3757e1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.177066 Nov 22 16:48:15.641313 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 142/284] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:15 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:16.408040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:16.408877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:16.415590 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:16.416066 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:16.416859 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:16.417289 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:16.584177 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:16.593689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-65bff537-594a-47c2-9ef6-7fe80c1a8482 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.193768 Nov 22 16:48:16.594683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 143/285] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:16 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:16.666873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:16.667917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:16.677127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:16.677789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:16.680053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:16.680806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:16.846168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:16.859945 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b3b07413-c392-4cd0-8884-b90a1151caa2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.199163 Nov 22 16:48:16.860940 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 144/286] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:16 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:17.621048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:17.621926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:17.628434 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:17.628869 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:17.629652 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:17.630285 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:17.672766 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-eb84704b-a61b-4445-ac73-cad3de5ab659 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 28616 microversion: 2.20 time: 2.965040 Nov 22 16:48:17.677064 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 143/287] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:14 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 28616 bytes in 2967 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:17.806832 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:17.817717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2ed79a78-6552-4f36-a35b-a26d45a38953 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.203379 Nov 22 16:48:17.818308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 145/288] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:17 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:17.885160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:17.886039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:17.899658 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:17.900307 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:17.901169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:17.901898 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:18.266199 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:18.288020 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b48c37f9-cc7e-4f02-987b-ab4d8a93b8f0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.408912 Nov 22 16:48:18.320726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 144/289] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:17 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:18.688447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:18.690656 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:18.701528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:18.702536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:18.704175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:18.704836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:18.841721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:18.842342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:18.848708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:18.848844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:18.849536 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:18.850159 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:19.406829 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:19.418696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-59636cf4-e542-44aa-9594-9d7327317a79 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.582447 Nov 22 16:48:19.420066 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 145/290] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:18 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:19.427198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:19.428283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:19.448453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:19.449134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:19.450439 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:19.451235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:19.717601 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:19.731573 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-24d3a498-8ffa-45a9-833d-18f7abb8eda5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.310323 Nov 22 16:48:19.732551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 146/291] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:19 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:20.436764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:20.440889 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:20.444080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:20.444894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:20.445646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:20.446145 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:20.630943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:20.639866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b18bda45-a35c-4ec8-a47f-7d36145ff193 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.206895 Nov 22 16:48:20.640470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 147/292] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:20 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:20.769109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:20.770627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:20.798481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:20.799696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:20.801464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:20.802593 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:21.050169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:21.060108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f383b5ff-d53f-43c4-8f44-6a8f60b32d98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.297827 Nov 22 16:48:21.061061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 148/293] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:20 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:21.666436 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:21.667397 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:21.677319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:21.677973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:21.680148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:21.680813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:21.815771 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f18d2ccc-8b7a-4135-b446-a818073195ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 32270 microversion: 2.20 time: 3.131808 Nov 22 16:48:21.823708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 146/294] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:18 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 32270 bytes in 3141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:21.963211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:21.974589 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f991b440-a631-4fee-b481-4bf9f7833396 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1314 microversion: 2.1 time: 0.314651 Nov 22 16:48:21.975993 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 149/295] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:21 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:22.086414 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:22.088829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:22.098474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:22.099388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:22.102642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:22.103458 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:22.392737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:22.406447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ec53f2d8-1715-4e72-b420-be4c78732bc9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.329947 Nov 22 16:48:22.423864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 147/296] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:22 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:22.837468 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:22.840905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:22.849686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:22.850501 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:22.851541 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:22.852776 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:22.993953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:22.995191 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:23.012484 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:23.015577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:23.016870 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:23.018664 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:23.173706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6bd71a7f-b743-47d8-b69f-af114ee2775f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 32830 microversion: 2.20 time: 0.345709 Nov 22 16:48:23.180868 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 150/297] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:22 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 32830 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:23.303209 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:23.324744 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0631dc91-5e2f-428f-ae6c-b7431d0812d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1498 microversion: 2.1 time: 0.334866 Nov 22 16:48:23.326162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 148/298] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:22 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1498 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:23.456911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:23.464697 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:23.484623 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:23.485097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:23.486171 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:23.486623 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:23.681460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:23.696097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9d54f214-a464-453f-ad37-0c69e7fa8adb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.258671 Nov 22 16:48:23.698346 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 151/299] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:23 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:24.190673 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:24.192250 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:24.203269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.204062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.205443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.206213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.366735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e58c84e9-8eae-43ee-ab2b-c83e16e0f22e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 33231 microversion: 2.20 time: 0.181911 Nov 22 16:48:24.367927 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 149/300] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:24 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 33231 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:24.727374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:24.729404 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:24.740354 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.740947 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.743221 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.744051 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.759962 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:24.760852 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:24.773346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.774755 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.776472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.777235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.832714 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:48:24.938909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:24.955707 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a602ab05-338d-4687-94c8-a9c4c7e567f5 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 204 len: 0 microversion: 2.1 time: 0.205493 Nov 22 16:48:24.956622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 150/301] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:48:24 2021] DELETE /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 16:48:24.958479 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e3e9cb6f-5ece-489e-9d85-4bd281508516 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.241352 Nov 22 16:48:24.959504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 152/302] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:24 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:24.969724 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1955200385", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "2a62bbf3-57d3-4911-b985-dd1a10a31d27"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:24.971133 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9b8b0b5-bc04-4d49-add1-a9dd00057971"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:24.973160 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:24.984079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.984888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:24.986195 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:24.986864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.065547 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] validate_networks() for [('2a62bbf3-57d3-4911-b985-dd1a10a31d27', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:48:25.131510 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] HTTP exception thrown: Invalid volume: volume e9b8b0b5-bc04-4d49-add1-a9dd00057971 is already attached to instances: 9dc3b870-6198-463e-8ee9-b68bbb652e52 Nov 22 16:48:25.133461 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Returning 400 to user: Invalid volume: volume e9b8b0b5-bc04-4d49-add1-a9dd00057971 is already attached to instances: 9dc3b870-6198-463e-8ee9-b68bbb652e52 {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:48:25.134768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5330f17a-9dc9-4745-9196-349e5f3b9219 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170525 Nov 22 16:48:25.135872 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 151/303] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:48:24 2021] POST /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments => generated 174 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 16:48:25.144931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:25.146053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:25.162050 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.162865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.164337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.165047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.495448 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:25.506302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b0a91464-0419-4d62-9eb9-086564b503d8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1504 microversion: 2.1 time: 0.368778 Nov 22 16:48:25.509687 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 152/304] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:25 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1504 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:25.518645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:25.518645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:25.527886 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.528757 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.530099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.530774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.696221 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:48:25.697457 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:48:25.698754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:48:25.700090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:48:25.700797 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:48:25.724019 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.725156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.727180 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.727455 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'services' on Instance uuid 9dc3b870-6198-463e-8ee9-b68bbb652e52 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:48:25.728161 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.769648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Getting quotas for project 1322235371824c2aba7f0fdaea4775f2. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:48:25.790219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Getting quotas for user 9a64bf88a7e446c0aa8e8aeb1bdadac3 and project 1322235371824c2aba7f0fdaea4775f2. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:48:25.815581 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:48:25.819763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:48:25.902000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8b3c003a-586a-4119-a8c8-a0e5c6e594e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939044 Nov 22 16:48:25.903332 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 153/305] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:48:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:48:25.917321 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:25.918887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:25.927338 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.928215 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:25.931657 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:25.932510 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.053255 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c6220449-22e9-4d9b-8bc1-6f7d19d04e23 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments/e9b8b0b5-bc04-4d49-add1-a9dd00057971" status: 202 len: 0 microversion: 2.1 time: 0.541913 Nov 22 16:48:26.060478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 153/306] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:48:25 2021] DELETE /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments/e9b8b0b5-bc04-4d49-add1-a9dd00057971 => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:26.077745 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d250e707-b7bc-4c08-9281-efeb424cbfe6 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:26.079672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d250e707-b7bc-4c08-9281-efeb424cbfe6 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:26.121208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-63677ec5-da83-4683-a354-b3471c8d9649 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 33642 microversion: 2.20 time: 0.214744 Nov 22 16:48:26.122549 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 154/307] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:25 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 33642 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:26.145760 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:26.150941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:26.181440 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:26.182490 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.183706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:26.184311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.198796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d250e707-b7bc-4c08-9281-efeb424cbfe6 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:26.213069 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d250e707-b7bc-4c08-9281-efeb424cbfe6 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1219 microversion: 2.1 time: 0.150377 Nov 22 16:48:26.214740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 154/308] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:26 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:26.237570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:26.251528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:26.283587 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:26.284686 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.285907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:26.286548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.402348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3febeff3-699e-4056-8f24-60661b40edb0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185831 Nov 22 16:48:26.403795 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 155/309] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:48:26 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:26.534562 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:26.536607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:26.569653 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:26.572665 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.578193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:26.581616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:26.614017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:26.625398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-622b33b2-b6c7-4ca8-b116-1f3bb803a920 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.499902 Nov 22 16:48:26.626483 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 155/310] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:26 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:26.857273 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:26.868928 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-934f2d9b-8f4f-4c66-baff-055964025a32 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1504 microversion: 2.1 time: 0.341834 Nov 22 16:48:26.884366 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 156/311] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:26 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:27.136747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:27.137784 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:27.145917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.146438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.147303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.147865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.245845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:27.247380 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:27.256188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.256790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.257855 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.258283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.351427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4524142e-0a51-4f0f-9e0d-15248bef4f6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 36248 microversion: 2.20 time: 0.217368 Nov 22 16:48:27.352476 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 156/312] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:27 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 36248 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:48:27.425989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:27.428195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:27.440626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.442258 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.443560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.447494 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.510703 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d8eaa365-f523-480b-b4fe-096fe72db01c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089888 Nov 22 16:48:27.511750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 157/313] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:48:27 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:27.540337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:27.555433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f0a0152d-945a-41c8-af8d-cea0a54b23f3 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1271 microversion: 2.1 time: 0.315903 Nov 22 16:48:27.556828 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 157/314] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:27 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1271 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:27.663504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:27.664727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:27.676851 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.677709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.679807 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.680775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.894858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:27.895476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:27.909335 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.909527 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.911495 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:27.912240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:27.950101 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:27.969654 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4ae04b42-36d2-4a76-84d4-d42a90d5260b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.317533 Nov 22 16:48:27.971170 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 158/315] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:27 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:28.144188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:28.153602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d6e77e9d-a0ca-4a5b-bb73-7deb91da5b76 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1504 microversion: 2.1 time: 0.262779 Nov 22 16:48:28.156322 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 158/316] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:27 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:28.368071 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:28.369310 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:28.377551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.378016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.378918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.379364 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.526576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:28.527596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:28.534192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.534644 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.535490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.535967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.590842 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3892eec7-c1f0-40c7-b216-4ff0f51a1970 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069244 Nov 22 16:48:28.591801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 159/317] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:48:28 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 16:48:28.600485 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:28.602496 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:28.614293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.614895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.615930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.617596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.720108 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:28.731954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0920abd5-fa72-4d2d-baf8-eee0ced8fdd4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1279 microversion: 2.1 time: 0.138690 Nov 22 16:48:28.732984 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 160/318] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:28 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:28.741573 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-e1cb8c13-e30a-45d0-8312-5d0cd5fd339e req-de921617-39d6-4621-adac-928cb3101a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6da55b-1db7-41e9-b7ba-9a441494005f", "name": "network-vif-deleted", "tag": "a4e9ec81-9ed8-4c20-a1e7-57374d3f9e90"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:28.744568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:28.744568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:48:28.756313 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-e1cb8c13-e30a-45d0-8312-5d0cd5fd339e req-de921617-39d6-4621-adac-928cb3101a3c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:28.758166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-e1cb8c13-e30a-45d0-8312-5d0cd5fd339e req-de921617-39d6-4621-adac-928cb3101a3c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:28.774480 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-e1cb8c13-e30a-45d0-8312-5d0cd5fd339e req-de921617-39d6-4621-adac-928cb3101a3c service nova] Creating event network-vif-deleted:a4e9ec81-9ed8-4c20-a1e7-57374d3f9e90 for instance 7f6da55b-1db7-41e9-b7ba-9a441494005f on hv-cinder-80473 Nov 22 16:48:28.779912 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-e1cb8c13-e30a-45d0-8312-5d0cd5fd339e req-de921617-39d6-4621-adac-928cb3101a3c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045284 Nov 22 16:48:28.780809 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 161/319] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:28.814198 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-534471329", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "45736139-c6d0-4dea-bd82-3ebc3b844a1c"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:28.890782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] validate_networks() for [('45736139-c6d0-4dea-bd82-3ebc3b844a1c', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:48:29.392039 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:48:29.392600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:48:29.393178 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:48:29.393590 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:48:29.394125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:48:29.405368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.405824 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.406676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.407117 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.430197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:48:29.434482 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Getting quotas for user d7fd3afd3c5c48998728927ac2874231 and project a5d4f105bf7f47a8a530e61cecdb8ef3. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:48:29.448416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:48:29.451662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:48:29.501293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ebef626d-02d6-40b7-b552-92e4dc9bb4da tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691911 Nov 22 16:48:29.501836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 162/320] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:48:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 16:48:29.506407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:29.507406 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:29.514268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.514770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.515628 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.516143 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.715416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:29.726643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-115eafdb-154d-476a-951b-a7a159b7ae59 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.222811 Nov 22 16:48:29.727365 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 163/321] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:29 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:29.731951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:29.732824 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:29.739581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.740360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.741902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.742516 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.830382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:29.840658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6ab94985-26fc-431b-9cda-f1a0c81eac58 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1462 microversion: 2.1 time: 0.112022 Nov 22 16:48:29.841293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 164/322] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:29 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1462 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:29.852042 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-45aa73e8-e75f-400c-b467-eedfae6b4dc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:29.853109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-45aa73e8-e75f-400c-b467-eedfae6b4dc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:29.924292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-45aa73e8-e75f-400c-b467-eedfae6b4dc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:29.934758 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-45aa73e8-e75f-400c-b467-eedfae6b4dc7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1217 microversion: 2.1 time: 0.092341 Nov 22 16:48:29.935629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 165/323] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:29 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:29.946865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:29.948343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:29.956735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.957322 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:29.958237 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:29.958786 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:30.038622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:30.047535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ebf9a887-e199-4eca-add4-344baeb752a5 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1289 microversion: 2.1 time: 0.110560 Nov 22 16:48:30.048183 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 166/324] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:29 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:30.756342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:30.757932 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:30.768276 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:30.769067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:30.770471 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:30.771243 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:30.966188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:30.974680 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-67195b93-f5f0-4c1f-8329-5d2db77cf043 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.224978 Nov 22 16:48:30.975263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 167/325] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:30 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:30.979697 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:30.980430 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:30.988168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:30.988688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:30.989588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:30.990349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:31.088860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:31.097464 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-bee387c1-34ae-439c-8457-dec5879989d6 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 200 len: 1462 microversion: 2.1 time: 0.121185 Nov 22 16:48:31.098091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 168/326] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:30 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 1462 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:31.103308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:31.103939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:31.113568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:31.116127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:31.117355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:31.118296 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:31.181214 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-54f0882c-c291-4e5e-b336-c438a5ccdbcd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 38105 microversion: 2.20 time: 2.819947 Nov 22 16:48:31.183150 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 159/327] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:28 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 38105 bytes in 2823 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:31.190157 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:31.191446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:31.200761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:31.201761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:31.202944 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:31.203538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:31.215920 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:31.224992 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b421b0ba-b260-4b53-870d-de1a5d2b43f0 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1221 microversion: 2.1 time: 0.125751 Nov 22 16:48:31.230446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 169/328] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:31 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1221 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:31.320375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:31.330576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4572cbb0-9b8e-4eee-89de-ac0dc1954dc2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1277 microversion: 2.1 time: 0.145685 Nov 22 16:48:31.331528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 160/329] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:31 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:32.018745 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:32.019609 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:32.034018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.034463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.035275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.035713 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.125592 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:32.126727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: 7f6da55b-1db7-41e9-b7ba-9a441494005f] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:32.157835 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.158596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.160078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.160834 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.225117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] HTTP exception thrown: Instance 7f6da55b-1db7-41e9-b7ba-9a441494005f could not be found. Nov 22 16:48:32.232660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Returning 404 to user: Instance 7f6da55b-1db7-41e9-b7ba-9a441494005f could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:48:32.234436 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b2e68d36-637f-42ee-8636-08d7d38f2028 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f" status: 404 len: 111 microversion: 2.1 time: 0.115982 Nov 22 16:48:32.237317 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 161/330] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:32 2021] GET /compute/v2.1/servers/7f6da55b-1db7-41e9-b7ba-9a441494005f => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:48:32.275010 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:32.277060 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:32.289085 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.290099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.291730 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.293006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.340166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:32.352334 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-61643dcc-f739-400f-a8dc-6b796637bb10 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.348717 Nov 22 16:48:32.352954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 170/331] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:32 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:32.369950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:32.371435 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:32.383015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.383766 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.385912 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.386946 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.456367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-51d337d4-7afc-4598-a660-94eab50d4654 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 38105 microversion: 2.20 time: 0.216019 Nov 22 16:48:32.458907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 162/332] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:32 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 38105 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:32.477254 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:32.479287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:32.509003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.510127 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.511781 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:32.512962 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:32.587951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:32.602104 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-16aa9c1c-ad6e-4506-946a-34972d36997f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1269 microversion: 2.1 time: 0.246073 Nov 22 16:48:32.616770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 171/333] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:32 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1269 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:32.616770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1070820556", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "790b6599-ac85-430c-a04c-ca0ad620f7a7"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:32.739858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] validate_networks() for [('790b6599-ac85-430c-a04c-ca0ad620f7a7', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:48:32.929468 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:32.950405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d614d79d-314b-4c8c-9a35-0c52e2e29ba2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.487738 Nov 22 16:48:32.953931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 163/334] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:32 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:33.358581 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-2c9e8705-8958-4d82-9041-df392940d816 req-5a2f2baf-caf5-410b-bc87-69b5324c6ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c904c32-a712-42f3-b763-fc8092114b36", "tag": "f9308e9c-c6a8-4400-800b-7b08a32aa7eb"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:33.360178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:33.360178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:48:33.383632 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-2c9e8705-8958-4d82-9041-df392940d816 req-5a2f2baf-caf5-410b-bc87-69b5324c6ef9 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.384105 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-2c9e8705-8958-4d82-9041-df392940d816 req-5a2f2baf-caf5-410b-bc87-69b5324c6ef9 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.398135 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-2c9e8705-8958-4d82-9041-df392940d816 req-5a2f2baf-caf5-410b-bc87-69b5324c6ef9 service nova] Creating event network-changed:f9308e9c-c6a8-4400-800b-7b08a32aa7eb for instance 2c904c32-a712-42f3-b763-fc8092114b36 on hv-cinder-80473 Nov 22 16:48:33.404079 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-2c9e8705-8958-4d82-9041-df392940d816 req-5a2f2baf-caf5-410b-bc87-69b5324c6ef9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050450 Nov 22 16:48:33.404891 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 164/335] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:48:33.417223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:33.421948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:33.442554 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.443051 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.452170 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.452418 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.490451 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:48:33.491508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:48:33.492375 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:48:33.493762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:48:33.494501 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:48:33.505938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.511298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.512701 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.513369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.534003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Getting quotas for project d53fc1c502384324bad19d3be7486258. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:48:33.539716 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Getting quotas for user aeefa547696c40f7bbd0b632ff08d60a and project d53fc1c502384324bad19d3be7486258. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:48:33.564179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:48:33.570343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:48:33.662468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-dabfa204-cc3a-48da-897b-44e483f8e21b tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051193 Nov 22 16:48:33.664373 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 172/336] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:48:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:48:33.669814 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:33.671951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:33.681491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.682228 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.683193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.683885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.688432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:33.719764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2a9c18e5-36b4-4535-a758-7ea301c188e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.313421 Nov 22 16:48:33.725367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 165/337] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:33 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:33.731436 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:33.733159 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:33.744552 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.745851 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.746930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:33.749407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:33.838269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d1327780-51a6-44e7-8380-5915edf58b94 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 38105 microversion: 2.20 time: 0.171968 Nov 22 16:48:33.844255 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 173/338] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:33 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 38105 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:33.863007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4b016b39-ecd0-460f-b990-f07ff833c359 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:33.868194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4b016b39-ecd0-460f-b990-f07ff833c359 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:33.920160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:33.938262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-176107ae-bddc-442b-ac81-1336985b4958 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1275 microversion: 2.1 time: 0.209009 Nov 22 16:48:33.940377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 166/339] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:33 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:33.987311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:33.987311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:34.001877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:34.009005 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:34.010151 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:34.012690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:34.073674 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4b016b39-ecd0-460f-b990-f07ff833c359 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:34.084892 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4b016b39-ecd0-460f-b990-f07ff833c359 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1214 microversion: 2.1 time: 0.242397 Nov 22 16:48:34.096549 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 174/340] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:33 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:34.351284 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:34.363050 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5def3af0-c557-4484-a87d-d7f053eebdee tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.395723 Nov 22 16:48:34.370049 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 167/341] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:33 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:34.751854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:34.753923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:34.765549 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:34.766415 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:34.768630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:34.769630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:34.875616 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:34.879872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:34.905677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:34.906125 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:34.907098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:34.907689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:34.968639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:34.981395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6bed9764-2a93-4d83-bbe7-f82a0603718f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1502 microversion: 2.1 time: 0.238182 Nov 22 16:48:34.982451 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 175/342] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:34 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:34.987774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:34.988508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:35.003729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.004873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.007307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.008121 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.095117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-19f5411b-9054-42ff-8243-295d660c66ca tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 38105 microversion: 2.20 time: 0.247053 Nov 22 16:48:35.095952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 168/343] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:34 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 38105 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:48:35.103347 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d344291-1541-42fd-977f-5a029bb30a35"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:35.104559 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:35.113032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.113664 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.114887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.115448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.166612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] HTTP exception thrown: Cannot 'attach_volume' instance a3997288-5b3f-4013-bcad-f59ce5f32db3 while it is in vm_state rescued Nov 22 16:48:35.167711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Returning 409 to user: Cannot 'attach_volume' instance a3997288-5b3f-4013-bcad-f59ce5f32db3 while it is in vm_state rescued {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:48:35.169346 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-31b90a72-e1fc-400c-a7e4-14acae7c227c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071698 Nov 22 16:48:35.170605 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 169/344] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:48:35 2021] POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 152 bytes in 74 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 22 16:48:35.188188 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:35.188839 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:35.201595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.202813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.204636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.206706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.257604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:35.267535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-76964bd6-734b-4d55-b16f-42dc4dfeffa8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.283129 Nov 22 16:48:35.268746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 176/345] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:34 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:35.275241 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:35.276394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:35.286742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.287511 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.290088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.290526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.324129 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:35.342590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-59e32527-5bc4-4d77-9f67-cf528a634c22 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1266 microversion: 2.1 time: 0.163591 Nov 22 16:48:35.343845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 170/346] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:35 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:35.386333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:35.387869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:35.421443 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.421998 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.423560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.424324 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.430993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3174dd9e-d193-484d-a3c8-20fd18deb359 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action" status: 202 len: 0 microversion: 2.1 time: 0.160262 Nov 22 16:48:35.433268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 177/347] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:48:35 2021] POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:35.447608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:35.448908 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:35.462931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.464148 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:35.465524 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:35.466476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.029847 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:36.061490 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-87b629d3-99e7-4684-9fc8-6a0373d4d334 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.681094 Nov 22 16:48:36.081115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 171/348] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:35 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:36.122208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:36.124314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:36.138531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.139401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.140695 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.141752 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.154985 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:36.167732 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c903afd8-d3ec-430e-887f-567f9e4c1c1c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1510 microversion: 2.1 time: 0.728530 Nov 22 16:48:36.174829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 178/349] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:35 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1510 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:36.284740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3ebec767-d2b4-4727-af1a-e6c66c1a247c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 38116 microversion: 2.20 time: 0.174188 Nov 22 16:48:36.291108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 172/350] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:36 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 38116 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:36.299249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:36.300588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:36.310249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.311341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.312818 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.313880 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.367538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:36.374340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:36.394051 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.397527 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.400605 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.401523 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.839595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:36.849816 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b878cbda-9713-49c1-b149-8cb89582f9d0 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1272 microversion: 2.1 time: 0.492686 Nov 22 16:48:36.853398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 173/351] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:36 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:36.861671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-e6fcea1d-06be-48a4-ae43-f74d0f6400ea req-38a6899e-6a8e-4f83-9546-6ade056eb81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9071056-f1dc-4e11-bfdd-b9b16c904315", "tag": "f517142f-6509-4a2f-bd98-e43b5a85495f"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:36.863954 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:36.863954 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:48:36.877997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e6fcea1d-06be-48a4-ae43-f74d0f6400ea req-38a6899e-6a8e-4f83-9546-6ade056eb81e service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:36.879407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e6fcea1d-06be-48a4-ae43-f74d0f6400ea req-38a6899e-6a8e-4f83-9546-6ade056eb81e service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:36.920595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-e6fcea1d-06be-48a4-ae43-f74d0f6400ea req-38a6899e-6a8e-4f83-9546-6ade056eb81e service nova] Creating event network-changed:f517142f-6509-4a2f-bd98-e43b5a85495f for instance d9071056-f1dc-4e11-bfdd-b9b16c904315 on hv-cinder-80473 Nov 22 16:48:36.933255 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-e6fcea1d-06be-48a4-ae43-f74d0f6400ea req-38a6899e-6a8e-4f83-9546-6ade056eb81e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076138 Nov 22 16:48:36.940425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 174/352] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:36.950663 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:36.962089 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-79bc3210-41cc-487d-b388-a04be20f3bb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.669719 Nov 22 16:48:36.963118 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 179/353] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:36 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:37.095703 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:37.096459 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:37.113431 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.113994 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.120687 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.121155 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.194191 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:37.200227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:37.212616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.213063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.233466 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.236762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.576245 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:37.590969 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e93e72f9-c9ab-4589-a9d6-7e253022641a tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.500349 Nov 22 16:48:37.596136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 175/354] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:37 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:37.604037 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:37.605822 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:37.623667 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.629447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.634457 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.636175 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.672525 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:37.719678 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-72d86350-f0fd-404e-979c-2cbe2d330ffe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1510 microversion: 2.1 time: 0.522548 Nov 22 16:48:37.721601 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 180/355] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:37 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1510 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:37.857109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bfdafee7-9a7b-4954-a38c-e34752ffe67e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 200 len: 38245 microversion: 2.20 time: 0.259525 Nov 22 16:48:37.858013 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 176/356] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:37 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 38245 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:48:37.868973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:37.869598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:37.888662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.889477 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.890917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.891507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:37.892943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:37.898952 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.915358 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.921030 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:37.922225 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:37.928019 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.019068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-22331484-3c2c-4d11-be84-79c059be0f90 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/ips" status: 200 len: 152 microversion: 2.20 time: 0.146012 Nov 22 16:48:38.026235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 177/357] 10.222.0.61 () {60 vars in 1288 bytes} [Mon Nov 22 16:48:37 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/ips => generated 152 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:48:38.044428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:38.046951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:38.056529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:38.057414 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.058399 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:38.058991 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.223170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:38.233612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e9904b81-47fc-404d-8322-1efbeff8abd8 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.368717 Nov 22 16:48:38.236524 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 181/358] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:37 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:38.373440 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:38.387218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4bf5cc40-05fb-4d63-baa7-789baf88c50a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.358829 Nov 22 16:48:38.401904 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 178/359] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:38 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:38.628112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:38.628112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:38.630132 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:38.630599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.631976 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:38.632473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.743200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:38.743986 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:38.754661 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:38.755366 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.757533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:38.760179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:38.972262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:38.981809 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-55dbd8e7-0b5b-446f-9daf-0bbab1a7b8e8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.363578 Nov 22 16:48:38.992402 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 182/360] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:38 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:39.133652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:39.144916 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6d95e871-5714-40f7-ae5b-a52c2ede5da0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1510 microversion: 2.1 time: 0.410063 Nov 22 16:48:39.147100 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 179/361] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:38 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1510 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:39.254564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:39.258710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:39.266635 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:39.267284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:39.268346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:39.269618 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:39.404720 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:39.405377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:39.427318 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:39.427773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:39.431879 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:39.437054 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:39.588894 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:39.599323 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d213bfca-d3f4-4390-8d0b-fb918191a201 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.350050 Nov 22 16:48:39.599935 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 183/362] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:39 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:39.720255 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:39.736056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-13dd9acc-032b-4a64-82ee-9f71cb6fd877 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.334998 Nov 22 16:48:39.737268 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 180/363] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:39 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:39.743077 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-6bc81f28-e5ca-48c9-b6af-034231afc291 req-79ba17ac-0eed-4570-ab34-674642830018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8cf1401-c1f2-4bd3-842e-7908c1ae4a26", "tag": "e1618e4e-094e-4822-88ce-1868ed671ee2"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:39.745281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:39.745281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:48:39.755445 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-6bc81f28-e5ca-48c9-b6af-034231afc291 req-79ba17ac-0eed-4570-ab34-674642830018 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:39.756114 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-6bc81f28-e5ca-48c9-b6af-034231afc291 req-79ba17ac-0eed-4570-ab34-674642830018 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:39.772875 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-6bc81f28-e5ca-48c9-b6af-034231afc291 req-79ba17ac-0eed-4570-ab34-674642830018 service nova] Creating event network-changed:e1618e4e-094e-4822-88ce-1868ed671ee2 for instance f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 on hv-cinder-80473 Nov 22 16:48:39.778145 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-6bc81f28-e5ca-48c9-b6af-034231afc291 req-79ba17ac-0eed-4570-ab34-674642830018 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039401 Nov 22 16:48:39.779345 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 184/364] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:48:40.023690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:40.025677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:40.043657 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.050189 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.053799 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.054689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.169163 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:40.169878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:40.189897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.190358 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.191169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.191614 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.257679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:40.266073 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5163a9ec-d14b-4698-937d-00827310d2bc tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.268474 Nov 22 16:48:40.267198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 181/365] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:39 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:40.394147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:40.410627 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-80fef0c4-aa13-46ca-856d-cccccdebb6c0 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1516 microversion: 2.1 time: 0.246202 Nov 22 16:48:40.411380 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 185/366] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:40 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:40.618812 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:40.620580 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:40.622092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:40.622683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:40.633917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.634830 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.636203 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.637349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.639760 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.640424 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.641233 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:40.641662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:40.693388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lazy-loading 'flavor' on Instance uuid 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:48:40.945425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:40.978645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-457ec8b7-4d8b-4aa6-91e8-ab221054ac67 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.364882 Nov 22 16:48:40.979617 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 182/367] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:40 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:40.999365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:41.000287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:41.008064 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.008765 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.009733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.010740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.052896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6b7d024d-92b5-4701-9984-75e7fff16b83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 202 len: 0 microversion: 2.20 time: 0.434487 Nov 22 16:48:41.053571 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 186/368] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:48:40 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:48:41.078646 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:41.079418 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:41.091429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.092123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.093048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.093628 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.354129 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:41.395775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:41.405364 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:41.408490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:41.410465 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f9ede2de-ecc3-4bd1-9f43-ee224a0fbfbf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.347276 Nov 22 16:48:41.413959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 187/369] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:41 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:41.435101 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:41.437308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:41.439985 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7bd7f005-f1dd-4589-9f15-288da6c2e71c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.458807 Nov 22 16:48:41.441164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 183/370] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:40 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:41.453087 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.454494 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.458355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.458969 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.651636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:41.664512 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0cbadcc2-80f5-49ec-a260-4aba16e80a0d tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.245777 Nov 22 16:48:41.665996 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 188/371] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:41 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:41.689784 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-91aa5a4a-26a0-4630-a0fb-6cdbc16ce029 req-dc3d765d-0f5f-4dfd-874e-9d63f72981f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c904c32-a712-42f3-b763-fc8092114b36", "name": "network-vif-plugged", "status": "completed", "tag": "f9308e9c-c6a8-4400-800b-7b08a32aa7eb"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:41.691471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:41.691471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:48:41.702068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-91aa5a4a-26a0-4630-a0fb-6cdbc16ce029 req-dc3d765d-0f5f-4dfd-874e-9d63f72981f8 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.702673 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-91aa5a4a-26a0-4630-a0fb-6cdbc16ce029 req-dc3d765d-0f5f-4dfd-874e-9d63f72981f8 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.730999 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-91aa5a4a-26a0-4630-a0fb-6cdbc16ce029 req-dc3d765d-0f5f-4dfd-874e-9d63f72981f8 service nova] Creating event network-vif-plugged:f9308e9c-c6a8-4400-800b-7b08a32aa7eb for instance 2c904c32-a712-42f3-b763-fc8092114b36 on hv-cinder-80473 Nov 22 16:48:41.739200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-91aa5a4a-26a0-4630-a0fb-6cdbc16ce029 req-dc3d765d-0f5f-4dfd-874e-9d63f72981f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052940 Nov 22 16:48:41.740272 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 184/372] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:41.947624 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:41.948314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:41.955802 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.956287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:41.957088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:41.957526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.005118 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:42.006286 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:42.016642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.016642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.017273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.017732 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.227875 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:42.235355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c443910f-0cc6-411d-a1a6-838933a18d6a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1516 microversion: 2.1 time: 0.291753 Nov 22 16:48:42.235945 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 189/373] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:41 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:42.254973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f5b7b3f-4c2f-4415-8e56-7e7849bfcff3"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:42.260842 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:42.266214 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:42.275159 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.275954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.277538 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.278318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.281644 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c8af65a9-9b2f-45e1-966c-f23e9c8c82f1 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.280042 Nov 22 16:48:42.282754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 185/374] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:41 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:42.441377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:42.442096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:42.449141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.449595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.450394 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.450826 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.644193 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:42.653567 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:42.655063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:42.656679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-119c4ac3-a9e8-4b2e-a8e6-647cc92d7c82 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.218961 Nov 22 16:48:42.657874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 186/375] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:42 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:48:42.679585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:42.681207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:42.691263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.692059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.692872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.693314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.814238 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4be519bd-cc4f-4573-8983-c76b1399da7e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563242 Nov 22 16:48:42.815212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 190/376] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:48:42 2021] POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:42.821084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:42.821796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:42.828194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.829530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.830548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:42.831190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:42.890598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:42.901184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e86cb07e-d2e4-4d10-a3b1-33a6458ff514 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.242262 Nov 22 16:48:42.910298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 187/377] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:42 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:43.034764 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:43.046139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-26499065-2bbe-40a3-9025-879dfecde37f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1319 microversion: 2.1 time: 0.229280 Nov 22 16:48:43.046889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 191/378] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:42 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:43.302359 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:43.303503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:43.312561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:43.313342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:43.314916 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:43.316149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:43.544323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:43.555570 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-807148a7-6dd5-4dc9-a3d3-ff39a162d609 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.259193 Nov 22 16:48:43.560254 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 188/379] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:43 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:43.686320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:43.686916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:43.694784 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:43.695441 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:43.696338 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:43.696775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:43.883671 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:43.893378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:43.895862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:43.898068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-abd886ba-93a3-491e-9e36-f21be644e201 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.215148 Nov 22 16:48:43.898825 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 192/380] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:43 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:48:43.919015 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:43.919766 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:43.927226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:43.928005 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:43.930086 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:43.930697 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:44.066090 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:44.066775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:44.075749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:44.076827 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:44.077965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:44.078550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:44.221283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:44.231194 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ef60d15f-8660-4dde-846c-bdea018a5b43 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.316354 Nov 22 16:48:44.232210 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 189/381] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:43 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:44.347974 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:44.357807 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4da32ad4-73c9-4cf4-928c-27740beb8ebf tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1507 microversion: 2.1 time: 0.295606 Nov 22 16:48:44.358544 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 193/382] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:44 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:44.587292 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:44.588124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:44.594327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:44.594855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:44.595773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:44.596306 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:44.821529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:44.832746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-288a1d60-00ee-493c-a5ed-e8d2c55eaa8f tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.249998 Nov 22 16:48:44.833525 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 190/383] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:44 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:44.921691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:44.922642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:44.928782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:44.929380 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:44.930259 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:44.930647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:45.125867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:45.139402 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:45.142714 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:45.147374 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d84ef23d-74a7-4592-a7df-48da6984e2dd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.231491 Nov 22 16:48:45.165335 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 194/384] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:44 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:45.249120 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:45.249413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:45.261087 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:45.261798 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:45.262843 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:45.263318 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:45.377095 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-d9d5675d-24f1-48ab-ae30-cc7b32582e43 req-64220346-7433-4628-bbe0-a2f0fcd9feb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9071056-f1dc-4e11-bfdd-b9b16c904315", "name": "network-vif-plugged", "status": "completed", "tag": "f517142f-6509-4a2f-bd98-e43b5a85495f"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:45.379665 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:45.379665 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:48:45.389315 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d9d5675d-24f1-48ab-ae30-cc7b32582e43 req-64220346-7433-4628-bbe0-a2f0fcd9feb8 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:45.390473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d9d5675d-24f1-48ab-ae30-cc7b32582e43 req-64220346-7433-4628-bbe0-a2f0fcd9feb8 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:45.407719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-d9d5675d-24f1-48ab-ae30-cc7b32582e43 req-64220346-7433-4628-bbe0-a2f0fcd9feb8 service nova] Creating event network-vif-plugged:f517142f-6509-4a2f-bd98-e43b5a85495f for instance d9071056-f1dc-4e11-bfdd-b9b16c904315 on hv-cinder-80473 Nov 22 16:48:45.439400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-d9d5675d-24f1-48ab-ae30-cc7b32582e43 req-64220346-7433-4628-bbe0-a2f0fcd9feb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066313 Nov 22 16:48:45.440071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 195/385] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:45.450512 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:45.464824 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8d3b6f01-c22e-41a3-8520-9cddb6c7664f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.219316 Nov 22 16:48:45.465992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 191/386] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:45 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:45.853732 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:45.854432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:45.861789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:45.862266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:45.869754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:45.869754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:46.038045 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:46.046310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-19658603-91fe-42bc-a95a-0d8af94304b2 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.197196 Nov 22 16:48:46.046885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 196/387] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:45 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:46.183721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:46.184491 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:46.194710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:46.195189 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:46.196423 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:46.197068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:46.344503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:46.353347 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:46.354845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:46.356032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-34fc13ea-ea17-45d6-ab38-8a6bda2d13f1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.177789 Nov 22 16:48:46.356587 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 192/388] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:46 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:46.483931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:46.484666 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:46.491454 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:46.492016 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:46.493302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:46.493740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:46.663909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:46.671915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2a84954f-d74d-4ee6-a958-e4819a2133e8 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1317 microversion: 2.1 time: 0.191489 Nov 22 16:48:46.672487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 197/389] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:46 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:47.062884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:47.063669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:47.074948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.075432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.076266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.076708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.253231 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:47.264676 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9f32406d-3b05-464b-a5a0-8902d5e6faba tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.205559 Nov 22 16:48:47.265648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 193/390] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:47 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:47.376691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:47.382945 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:47.389290 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.390101 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.390942 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.391638 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.477975 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-eee006c8-2436-48cc-8c90-962597654548 req-4104faf1-0dfb-4bd1-be38-846033de6e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8cf1401-c1f2-4bd3-842e-7908c1ae4a26", "name": "network-vif-plugged", "status": "completed", "tag": "e1618e4e-094e-4822-88ce-1868ed671ee2"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:47.481243 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:47.481243 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:48:47.495511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-eee006c8-2436-48cc-8c90-962597654548 req-4104faf1-0dfb-4bd1-be38-846033de6e4a service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.496684 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-eee006c8-2436-48cc-8c90-962597654548 req-4104faf1-0dfb-4bd1-be38-846033de6e4a service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.517206 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-eee006c8-2436-48cc-8c90-962597654548 req-4104faf1-0dfb-4bd1-be38-846033de6e4a service nova] Creating event network-vif-plugged:e1618e4e-094e-4822-88ce-1868ed671ee2 for instance f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 on hv-cinder-80473 Nov 22 16:48:47.524018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-eee006c8-2436-48cc-8c90-962597654548 req-4104faf1-0dfb-4bd1-be38-846033de6e4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056137 Nov 22 16:48:47.524623 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 194/391] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:47.656578 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:47.666694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:47.668249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:47.669395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a5fb5a19-85d2-443d-a5aa-7ad60d20f943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.297569 Nov 22 16:48:47.675231 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 198/392] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:47 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:48:47.691564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:47.692482 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:47.704601 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.705586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.707435 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:47.708137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:47.920608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:47.930078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e2819a57-5fb9-4fe4-adc7-1e90ead8babc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1507 microversion: 2.1 time: 0.242453 Nov 22 16:48:47.931996 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 195/393] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:47 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1507 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:48.285788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:48.287344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:48.300528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:48.301882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:48.306191 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:48.308302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:48.524046 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:48.536393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f99ce98b-fad4-447f-9c6a-025ba6e066fe tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.256578 Nov 22 16:48:48.537027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 199/394] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:48 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:48.697343 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:48.698075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:48.705305 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:48.705910 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:48.706744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:48.707192 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:48.848749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:48.857168 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:48.858665 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:48.859839 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-32117d69-1bb2-4240-85d9-527985e4c79d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.167464 Nov 22 16:48:48.860413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 196/395] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:48 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:49.389589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1178067d-15e6-4755-8db5-4088195bf528"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:49.390742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:49.400349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:49.400349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:49.400349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:49.400349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:49.561402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:49.562031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:49.568577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:49.569274 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:49.569941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:49.570383 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:49.726157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e41feed2-6c11-444e-9b01-264cddcd32c7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "POST /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339471 Nov 22 16:48:49.730031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 200/396] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:48:49 2021] POST /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:48:49.755950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:49.765014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f322cdcd-a8bc-4b44-8b3d-665052953c62 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1314 microversion: 2.1 time: 0.213784 Nov 22 16:48:49.765593 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 197/397] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:49 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:49.881881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:49.883034 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:49.891619 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:49.892140 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:49.893120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:49.893695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:50.074604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:50.083031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:50.085943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:50.086904 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b2c9e5c3-1a4c-49c8-9280-52eac665eaae tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.209753 Nov 22 16:48:50.087729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 201/398] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:49 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:48:50.782531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:50.783211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:50.790641 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:50.791163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:50.792018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:50.792495 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:50.960788 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:50.969545 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-69b2e2da-b071-438a-b3eb-8529ca609175 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1498 microversion: 2.1 time: 0.190603 Nov 22 16:48:50.970290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 198/399] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:50 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1498 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:51.109204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:51.110305 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:51.121432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:51.122189 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:51.123020 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:51.123465 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:51.270047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:51.278689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:51.280190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:51.281400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5f90bce0-14b0-4ee7-a574-d3e5fff1dc15 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.179259 Nov 22 16:48:51.282120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 202/400] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:51 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:52.124790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:52.126342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:52.135903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.136498 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.138595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.139636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.174385 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lazy-loading 'flavor' on Instance uuid a3997288-5b3f-4013-bcad-f59ce5f32db3 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:48:52.232733 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:52.233162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:52.241139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.242515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.246018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.247211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.278641 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:48:52.379881 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-edc06d22-30c3-4aee-8351-39c3882ea19b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action" status: 200 len: 32 microversion: 2.1 time: 0.259291 Nov 22 16:48:52.380647 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 199/401] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:48:52 2021] POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:48:52.387094 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:52.387899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:52.400753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aae38354-fe68-42ec-b84d-6fecaed30dde tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 204 len: 0 microversion: 2.1 time: 0.170258 Nov 22 16:48:52.407707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.408392 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.409072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 203/402] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:48:52 2021] DELETE /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 16:48:52.409995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.411492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.415953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:52.416853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:52.426071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.426515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.428481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.429430 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.649167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:52.656510 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:52.661737 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:52.665634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:52.668273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-845eeb5c-05c9-4ad7-a56e-cd5af82d07c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.285832 Nov 22 16:48:52.669646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 200/403] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:52 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:52.674413 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-01881aa2-525b-49de-910a-ae04b8f5d8b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.262908 Nov 22 16:48:52.676334 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 204/404] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:52 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:52.678148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:52.679326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:52.688909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.690124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.691696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:52.692504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:52.873166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:52.884788 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0b144923-5a16-45d4-81e2-fd38debe2b77 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1504 microversion: 2.1 time: 0.213495 Nov 22 16:48:52.885515 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 201/405] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:52 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:53.700816 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:53.701792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:53.702277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:53.702895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:53.710585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:53.711036 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:53.711941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:53.712227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:53.712401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:53.713040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:53.714597 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:53.715192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:53.929174 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:53.932611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:53.938194 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:53.939746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:53.940600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-74c5abaa-e1aa-48bd-8b78-6cd3101b9773 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.243891 Nov 22 16:48:53.940953 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f03410bb-2620-4c1f-a5ce-673abe093370 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.242688 Nov 22 16:48:53.951623 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 205/406] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:53 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:53.951870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 202/407] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:53 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:48:53.951962 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:53.951962 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:53.953695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:53.954456 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:53.955265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:53.955701 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:54.102839 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:54.110589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0ad3d978-f851-41bf-a69e-ce9a67ca712e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1504 microversion: 2.1 time: 0.168285 Nov 22 16:48:54.111170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 206/408] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:53 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:54.958650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:54.959894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:54.964917 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:54.966252 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:54.967044 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:54.967573 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:54.968440 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:54.968880 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:54.972685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:54.973148 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:54.973946 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:54.974397 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:55.214379 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:55.219153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:55.232724 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a3de117b-d780-4cc9-a654-329a94b72c2e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.277683 Nov 22 16:48:55.233314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 203/409] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:54 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:55.237457 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:55.240049 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:55.242320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aef68227-e6e0-41b4-a675-3b8d03896fe5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.281290 Nov 22 16:48:55.243069 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 207/410] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:54 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:55.244828 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:55.245465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:55.252336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:55.252790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:55.253590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:55.254025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:55.324882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-2e1f2527-8740-4d24-a674-288c024a3d56 req-d4b08638-2e33-4b8c-958c-a97a6e847d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8cf1401-c1f2-4bd3-842e-7908c1ae4a26", "name": "network-vif-deleted", "tag": "e1618e4e-094e-4822-88ce-1868ed671ee2"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:48:55.326638 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:48:55.326638 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:48:55.336846 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2e1f2527-8740-4d24-a674-288c024a3d56 req-d4b08638-2e33-4b8c-958c-a97a6e847d3f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:55.337663 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2e1f2527-8740-4d24-a674-288c024a3d56 req-d4b08638-2e33-4b8c-958c-a97a6e847d3f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:55.342481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeefa547696c40f7bbd0b632ff08d60a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53fc1c502384324bad19d3be7486258', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:55.353497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-2e1f2527-8740-4d24-a674-288c024a3d56 req-d4b08638-2e33-4b8c-958c-a97a6e847d3f service nova] Creating event network-vif-deleted:e1618e4e-094e-4822-88ce-1868ed671ee2 for instance f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 on hv-cinder-80473 Nov 22 16:48:55.359447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-2e1f2527-8740-4d24-a674-288c024a3d56 req-d4b08638-2e33-4b8c-958c-a97a6e847d3f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038016 Nov 22 16:48:55.360668 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-40d51b5a-939e-4d02-a562-327817126798 tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 200 len: 1462 microversion: 2.1 time: 0.120870 Nov 22 16:48:55.361574 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 208/412] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:48:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:48:55.361786 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 204/412] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:55 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 1462 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:56.261756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:56.262757 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:56.263001 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:56.263939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:56.269039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:56.269501 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:56.270332 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:56.270480 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:56.270733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:56.271150 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:56.272493 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:56.272931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:56.509656 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:56.514853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:56.518542 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b7a5a248-2e67-4545-bdc7-f499294931bb tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.260895 Nov 22 16:48:56.519174 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 205/413] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:56 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:56.525749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:56.525749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] [instance: f8cf1401-c1f2-4bd3-842e-7908c1ae4a26] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:56.530240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:56.530648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:56.531097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:56.531905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:56.532341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:56.532723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:56.534701 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d1f64a19-c38c-4c40-b746-8c27ef320e0d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.276687 Nov 22 16:48:56.535963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 209/414] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:56 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:48:56.548689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] HTTP exception thrown: Instance f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 could not be found. Nov 22 16:48:56.549281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] Returning 404 to user: Instance f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:48:56.550093 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-72e91a55-1439-4c44-a228-f3d07b3a284e tempest-VolumesActionsTest-586068305 tempest-VolumesActionsTest-586068305-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26" status: 404 len: 111 microversion: 2.1 time: 0.030050 Nov 22 16:48:56.550631 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 206/415] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:56 2021] GET /compute/v2.1/servers/f8cf1401-c1f2-4bd3-842e-7908c1ae4a26 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:48:57.538337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:57.538972 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:57.547236 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:57.547773 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:57.548508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:57.549135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:57.558300 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:57.559016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:57.567082 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:57.567646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:57.569247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:57.569931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:57.811600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:57.822060 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:57.822572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:57.824210 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:57.825386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e85184ae-ead0-4bf5-bf5c-714ac0f66c6b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.274480 Nov 22 16:48:57.825944 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 207/416] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:57 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:57.838332 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-11094b7e-614c-4af3-a734-2c0c88bb69d1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.304687 Nov 22 16:48:57.839668 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 210/417] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:57 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:48:58.845559 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:58.846340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:58.853594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:58.854356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:58.855139 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:58.856125 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:58.857659 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:58.858801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:58.869032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:58.869479 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:58.870622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:58.871220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:59.283110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:59.290186 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:59.292517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:59.294203 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:48:59.295575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6cd39944-6d27-4048-9242-194e2f3aa369 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.453813 Nov 22 16:48:59.296277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 208/418] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:48:58 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:48:59.303458 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-74360175-8b89-427b-a193-83b11a50a7e3 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.450566 Nov 22 16:48:59.304395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 211/419] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:48:58 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:48:59.854862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:48:59.855627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:48:59.866134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:59.867158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:59.868444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:48:59.869145 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:48:59.972325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'services' on Instance uuid d9071056-f1dc-4e11-bfdd-b9b16c904315 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:00.056390 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-acd76cfd-1d4b-42d3-bf0f-ac2bef2b05ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments/1178067d-15e6-4755-8db5-4088195bf528" status: 202 len: 0 microversion: 2.1 time: 0.215390 Nov 22 16:49:00.057219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 209/420] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:48:59 2021] DELETE /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments/1178067d-15e6-4755-8db5-4088195bf528 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:49:00.067566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:00.069725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:00.080339 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:00.081106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:00.082312 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:00.083116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:00.137249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-71a8838e-df5e-40df-b41c-173b78329d09 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074727 Nov 22 16:49:00.137751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 212/421] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:00 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:00.322892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:00.323596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:00.324835 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:00.325577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:00.332808 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:00.333505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:00.335333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:00.336338 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:00.336529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:00.336808 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:00.338393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:00.339696 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:00.609331 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:00.616833 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:00.618899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-07a2ffe1-82d2-4652-8cd5-850cf7b5f82a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.298211 Nov 22 16:49:00.619576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 213/422] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:00 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:00.631237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:00.634091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:00.635326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f03bb40f-4735-4c5e-9529-d1c98b381b38 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.316819 Nov 22 16:49:00.635908 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 210/423] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:00 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:01.154637 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:01.156193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:01.166902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:01.167693 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:01.169048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:01.169771 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:01.216620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-08d88387-3649-4ed5-bb95-679fc5c70d1a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068777 Nov 22 16:49:01.217331 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 214/424] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:01 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:01.635964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:01.636725 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:01.643236 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:01.643682 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:01.644504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:01.644939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:01.657731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:01.658476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:01.666140 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:01.666591 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:01.667390 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:01.667854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:01.888022 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:01.896083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:01.901714 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-da7db44f-f270-48ac-b3e6-6309e183127d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.269036 Nov 22 16:49:01.902615 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 211/425] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:01 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:01.906243 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:01.907914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:01.909147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fbd4be99-fab5-473d-a99c-26fa46049021 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.255770 Nov 22 16:49:01.910073 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 215/426] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:01 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:02.231432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:02.232568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:02.238919 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:02.239460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:02.241762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:02.242357 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:02.286175 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-df4316f6-1438-46b4-ada8-0268f45ae62a tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058562 Nov 22 16:49:02.287226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 212/427] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:02 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:49:02.922862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:02.923858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:02.930100 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:02.931360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:02.934963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:02.935569 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:02.936596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:02.937206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:02.937866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:02.938502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:02.939299 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:02.939740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:03.159133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:03.169222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:03.171883 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:03.174637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:03.176627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7e8f1347-dd70-4721-8e00-faeef2f834ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.252234 Nov 22 16:49:03.178122 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 213/428] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:02 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:03.181789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-43b180fc-1f49-45d4-9d3d-b01b87a67b1a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.263619 Nov 22 16:49:03.182394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 216/429] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:02 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:03.513901 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:03.514445 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:03.524715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:03.525439 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:03.526756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:03.527469 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:03.557096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:49:03.657527 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a757108e-11ff-4f8d-ae1c-249d9253d14d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 204 len: 0 microversion: 2.1 time: 0.148692 Nov 22 16:49:03.658374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 214/430] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:49:03 2021] DELETE /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 16:49:03.666715 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:03.667355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:03.674050 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:03.674570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:03.675351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:03.675829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:03.831017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:03.839695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c6504386-dca1-40f9-a825-5f9770c564bb tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1513 microversion: 2.1 time: 0.176773 Nov 22 16:49:03.840304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 217/431] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:03 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:04.199478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:04.200171 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:04.200526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:04.200627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:04.206979 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:04.207690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:04.207855 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:04.208313 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:04.208750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:04.209169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:04.209986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:04.210429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:04.433368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:04.435528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:04.444521 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1d47c2df-fd11-47db-926a-f8038623d459 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.248662 Nov 22 16:49:04.445098 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 218/432] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:04 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:04.447625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:04.449239 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:04.450403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3861b7fa-af44-4e94-b51a-4fb36fa4cabd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.254849 Nov 22 16:49:04.450942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 215/433] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:04 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:04.859326 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:04.859982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:04.866487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:04.866925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:04.868020 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:04.868453 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:05.031786 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:05.041130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e09e760d-5584-491c-80b9-c7a6069ad9b7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1513 microversion: 2.1 time: 0.186949 Nov 22 16:49:05.041721 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 219/434] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:04 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:05.464303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:05.465052 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:05.470138 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:05.471182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:05.471368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:05.471849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:05.472651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:05.473095 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:05.478100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:05.478554 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:05.479369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:05.479813 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:05.694291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:05.694609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:05.703815 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:05.704040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f70c3b00-c257-4bea-9795-185bf68e2a51 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.243618 Nov 22 16:49:05.704590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 216/435] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:05 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:05.705392 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:05.706556 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-071558e3-91ef-4ce9-b0e4-d559fddeb521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.240289 Nov 22 16:49:05.707100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 220/436] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:05 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:06.060432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:06.061138 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:06.069006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:06.069452 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:06.070242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:06.070671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:06.246950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:06.257293 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e9d3f457-8657-4563-917f-45faf6084825 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1513 microversion: 2.1 time: 0.200053 Nov 22 16:49:06.258261 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 217/437] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:06 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:06.722344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:06.723433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:06.727725 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:06.728532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:06.731171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:06.731705 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:06.732595 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:06.733180 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:06.736205 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:06.736205 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:06.737600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:06.737600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:07.007772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:07.024899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-20fb95d6-9c76-47d3-83e5-3bf0da8ed5ad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.306437 Nov 22 16:49:07.025767 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 221/438] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:06 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:07.028202 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:07.033730 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-160ddbc6-9ba1-4356-a071-7d73d2173682 req-bd2e25ad-9d2a-431f-a4d7-2806a32b67b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9071056-f1dc-4e11-bfdd-b9b16c904315", "name": "network-vif-deleted", "tag": "f517142f-6509-4a2f-bd98-e43b5a85495f"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:07.036219 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:49:07.036219 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:49:07.043196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:07.045076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:07.046259 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3fcd006b-e320-4454-a408-92774d118d84 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.325371 Nov 22 16:49:07.051041 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-160ddbc6-9ba1-4356-a071-7d73d2173682 req-bd2e25ad-9d2a-431f-a4d7-2806a32b67b5 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:07.051499 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-160ddbc6-9ba1-4356-a071-7d73d2173682 req-bd2e25ad-9d2a-431f-a4d7-2806a32b67b5 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:07.068638 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 218/439] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:06 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:07.097640 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-160ddbc6-9ba1-4356-a071-7d73d2173682 req-bd2e25ad-9d2a-431f-a4d7-2806a32b67b5 service nova] Creating event network-vif-deleted:f517142f-6509-4a2f-bd98-e43b5a85495f for instance d9071056-f1dc-4e11-bfdd-b9b16c904315 on hv-cinder-80473 Nov 22 16:49:07.105271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-160ddbc6-9ba1-4356-a071-7d73d2173682 req-bd2e25ad-9d2a-431f-a4d7-2806a32b67b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076859 Nov 22 16:49:07.105876 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 222/440] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:49:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:07.278707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:07.279080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:07.286254 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:07.286762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:07.288263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:07.288263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:07.323941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:07.324395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:07.324850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'fault' on Instance uuid d9071056-f1dc-4e11-bfdd-b9b16c904315 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:07.368909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:07.377050 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d06f206a-4136-44ff-b138-be33bb548485 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1307 microversion: 2.1 time: 0.102998 Nov 22 16:49:07.377685 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 219/441] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:07 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:08.049152 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:08.049842 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:08.057332 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.057772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.058557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.058986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.075245 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:08.075885 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:08.082423 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.082877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.083716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.084590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.273288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:08.287499 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c8c5cb3b-e4d2-485c-9271-6499c2ea65b5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.242661 Nov 22 16:49:08.295025 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 223/442] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:08 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:08.297109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:08.306814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:08.308365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:08.309838 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c012b6cf-2b66-4173-816f-4f80e26382d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1745 microversion: 2.20 time: 0.238667 Nov 22 16:49:08.310755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 220/443] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:08 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1745 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:08.394499 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:08.395111 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:08.405696 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.406149 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.406949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.407385 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.441700 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:08.442149 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:08.442607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'fault' on Instance uuid d9071056-f1dc-4e11-bfdd-b9b16c904315 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:08.490378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:08.498724 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6e2a863b-ba79-44d7-8c19-81a38401f598 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1307 microversion: 2.1 time: 0.108124 Nov 22 16:49:08.499312 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 224/444] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:08 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:09.305382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:09.306089 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:09.312810 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.313357 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.314152 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.314632 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.333403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:09.335419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:09.348970 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.348970 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.348970 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.350285 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.562843 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:09.570093 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:09.577548 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f6f3abff-de53-4f55-8e21-ccf96a6cb6fe tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.276428 Nov 22 16:49:09.578590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 221/445] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:09 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:09.580700 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:09.582408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:09.584455 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-811f8b5b-8bc1-4f80-8888-0329f8cdcac0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1745 microversion: 2.20 time: 0.255939 Nov 22 16:49:09.585171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 225/446] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:09 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1745 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:09.587343 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:09.588076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:09.594280 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.594749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.595528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.595997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.627550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:09.628065 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:09.628570 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'fault' on Instance uuid d9071056-f1dc-4e11-bfdd-b9b16c904315 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:09.670540 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:09.681548 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8be0343e-b55f-4d30-8971-9e989b62523b tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1307 microversion: 2.1 time: 0.101409 Nov 22 16:49:09.682140 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 222/447] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:09 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:10.601738 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:10.602349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:10.608112 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:10.609188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.609339 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:10.610051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.610998 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.611520 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.616419 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.616955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.617819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.618255 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.840273 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:10.852121 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-76f0262d-ee44-45b4-a0f2-a4c3e26f7ec4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.254979 Nov 22 16:49:10.852708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 226/448] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:10 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:10.852975 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:10.858994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:10.859836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:10.860974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:10.862471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:10.863604 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c553c4a2-60be-40ff-82a8-caf29c7c1648 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1745 microversion: 2.20 time: 0.259279 Nov 22 16:49:10.864454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 223/449] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:10 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1745 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:10.870508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.871079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.871915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.872359 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.911416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:10.912306 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:10.913097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'fault' on Instance uuid d9071056-f1dc-4e11-bfdd-b9b16c904315 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:10.956576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:10.965331 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9e596a10-dff0-4bfc-a85c-688871c58cac tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 200 len: 1307 microversion: 2.1 time: 0.111236 Nov 22 16:49:10.965992 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 227/450] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:10 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:11.874657 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:11.875307 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:11.883391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:11.883854 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:11.884006 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:11.884691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:11.884921 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:11.885111 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:11.894821 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:11.895264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:11.896167 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:11.896609 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:12.103719 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:12.109119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:12.119786 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:12.120126 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f447fd86-4e70-4f92-9602-d917a0327497 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.248748 Nov 22 16:49:12.131861 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 224/451] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:11 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:12.132889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:12.132889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e0dce26a-b888-400e-baf9-ccb90212a42f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1745 microversion: 2.20 time: 0.247024 Nov 22 16:49:12.132889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 228/452] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:11 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1745 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:12.133236 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:12.133236 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: d9071056-f1dc-4e11-bfdd-b9b16c904315] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:12.136913 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:12.137344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:12.138152 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:12.138594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:12.153645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] HTTP exception thrown: Instance d9071056-f1dc-4e11-bfdd-b9b16c904315 could not be found. Nov 22 16:49:12.154246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Returning 404 to user: Instance d9071056-f1dc-4e11-bfdd-b9b16c904315 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:49:12.155088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ca6bd1d8-a1d2-4fa9-9768-fdd511fce82c tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315" status: 404 len: 111 microversion: 2.1 time: 0.032121 Nov 22 16:49:12.155659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 225/453] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:12 2021] GET /compute/v2.1/servers/d9071056-f1dc-4e11-bfdd-b9b16c904315 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:49:13.165686 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:13.168425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:13.168606 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:13.169700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:13.179796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.180705 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.181871 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.182570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.183329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.188599 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.190812 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.191974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.571303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:13.590556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-52fc5fc8-1121-445b-b0de-1ee9be5cd3f2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.440466 Nov 22 16:49:13.591498 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 226/454] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:13 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:13.609996 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:13.613289 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:13.629422 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.636019 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.637458 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.637909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.639429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:13.665819 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:13.700606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:13.703720 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-54c8730f-0076-4017-9312-6a3b24a7e521 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.557460 Nov 22 16:49:13.729192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 229/455] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:13 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:13.786080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:49:13.917459 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-94cfea7e-09be-4707-9680-5fc6a4c2a73d tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 204 len: 0 microversion: 2.1 time: 0.317930 Nov 22 16:49:13.918771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 227/456] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:49:13 2021] DELETE /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:49:13.930533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:13.932056 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:13.948258 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.949367 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:13.953647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:13.954590 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:14.168491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:14.189276 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-925b6754-1c34-49f3-bf28-f6b7c17c8438 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1513 microversion: 2.1 time: 0.265163 Nov 22 16:49:14.189887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 230/457] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:13 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:14.611091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:14.612079 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:14.626107 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:14.626503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:14.630035 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:14.634018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:14.754662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:14.755750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:14.766001 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:14.770737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:14.772557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:14.780682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:14.908363 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:14.920502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-546e0c85-4254-464c-ab99-e3f08f1e8885 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.313547 Nov 22 16:49:14.921619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 228/458] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:14 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:15.189497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:15.207291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:15.211088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:15.212843 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:15.214249 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:15.214654 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3b1a831b-dd7f-473c-8efc-8b3b503b9999 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.463041 Nov 22 16:49:15.232475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 231/459] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:14 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:15.241762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:15.242843 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:15.250453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:15.251246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:15.815577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:15.832284 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d638ef49-6c9b-4eb6-85d0-7028b8a96eb1 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1513 microversion: 2.1 time: 0.626874 Nov 22 16:49:15.834510 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 229/460] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:15 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1513 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:15.864475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-c5045461-6202-441f-bc84-ecf41c226362 req-99d4d802-b305-48fc-8df3-fb336cd91593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "name": "network-vif-plugged", "status": "completed", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:15.869668 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:49:15.869668 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:49:15.888355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-c5045461-6202-441f-bc84-ecf41c226362 req-99d4d802-b305-48fc-8df3-fb336cd91593 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:15.889596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-c5045461-6202-441f-bc84-ecf41c226362 req-99d4d802-b305-48fc-8df3-fb336cd91593 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:15.949770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:15.951165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:15.956723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-c5045461-6202-441f-bc84-ecf41c226362 req-99d4d802-b305-48fc-8df3-fb336cd91593 service nova] Creating event network-vif-plugged:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:49:15.978938 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:15.981135 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:15.982550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-c5045461-6202-441f-bc84-ecf41c226362 req-99d4d802-b305-48fc-8df3-fb336cd91593 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123372 Nov 22 16:49:15.986105 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:15.986775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 232/461] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:49:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:15.987923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:16.251082 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:16.257908 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:16.291199 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:16.301237 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:16.303382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:16.305016 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:16.308126 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-47ea7630-631d-4b5c-b19f-160fcbaa0c0d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.368632 Nov 22 16:49:16.308953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:16.313454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 230/462] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:15 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:16.858377 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:16.859146 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:16.869476 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:16.869749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:16.871128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:16.892297 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:16.904585 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:16.934369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:16.935986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:16.937539 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-858cfb78-d227-4b71-bc76-c3bdc60f8549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.695402 Nov 22 16:49:16.939610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 233/463] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:16 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:17.233861 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:17.279745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4c0026bb-2a23-4657-8e9b-385e873eaa35 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1513 microversion: 2.1 time: 0.427343 Nov 22 16:49:17.285015 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 231/464] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:16 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1513 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:17.330459 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:17.332007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:17.350708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:17.351581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:17.352841 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:17.353583 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:17.625706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-68b27a34-bdfb-49c4-8014-a95fde0c9664 req-4f021f4a-9ac6-4b32-99b4-edd839fb5925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc3b870-6198-463e-8ee9-b68bbb652e52", "name": "network-vif-deleted", "tag": "6262f34a-c749-4312-89ee-7e9ab39991c8"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:17.637421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:49:17.637421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:49:17.651428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:17.651931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-68b27a34-bdfb-49c4-8014-a95fde0c9664 req-4f021f4a-9ac6-4b32-99b4-edd839fb5925 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:17.652411 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-68b27a34-bdfb-49c4-8014-a95fde0c9664 req-4f021f4a-9ac6-4b32-99b4-edd839fb5925 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:17.663708 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c731096a-ba5e-468a-8839-38e483109317 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.336762 Nov 22 16:49:17.675610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 234/465] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:17 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:17.684473 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-68b27a34-bdfb-49c4-8014-a95fde0c9664 req-4f021f4a-9ac6-4b32-99b4-edd839fb5925 service nova] Creating event network-vif-deleted:6262f34a-c749-4312-89ee-7e9ab39991c8 for instance 9dc3b870-6198-463e-8ee9-b68bbb652e52 on hv-cinder-80473 Nov 22 16:49:17.734755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-68b27a34-bdfb-49c4-8014-a95fde0c9664 req-4f021f4a-9ac6-4b32-99b4-edd839fb5925 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116468 Nov 22 16:49:17.736945 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 232/466] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:49:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:17.974993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:17.976379 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:17.987648 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:17.995166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:17.997188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:17.998341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:18.313683 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:18.314695 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:18.357557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:18.359173 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:18.363420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:18.366522 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:18.428691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:18.450600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:18.452533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:18.457960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-af219a9a-0360-4f62-b3e7-8707d7f05690 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.486039 Nov 22 16:49:18.459696 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 235/467] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:17 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:18.501846 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:18.503283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:18.503283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'fault' on Instance uuid 9dc3b870-6198-463e-8ee9-b68bbb652e52 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:18.641050 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:18.659143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-01c187a9-1ab0-4078-841d-71a04de81cd3 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 200 len: 1307 microversion: 2.1 time: 0.352468 Nov 22 16:49:18.660389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 233/468] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:18 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 1307 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:18.686468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:18.687476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:18.711949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:18.712872 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:18.714271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:18.716478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.042409 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:19.059736 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a115b59b-f2ae-48e3-8388-ed1eb4d23f71 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.379744 Nov 22 16:49:19.073102 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 236/469] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:18 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:19.490407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:19.491685 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:19.515545 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:19.516351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.517921 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:19.519534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.683593 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:19.684467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 9dc3b870-6198-463e-8ee9-b68bbb652e52] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:19.695943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:19.698505 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.702824 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:19.705720 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.740419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] HTTP exception thrown: Instance 9dc3b870-6198-463e-8ee9-b68bbb652e52 could not be found. Nov 22 16:49:19.741482 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Returning 404 to user: Instance 9dc3b870-6198-463e-8ee9-b68bbb652e52 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:49:19.741895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f9c95c21-fc53-41ea-ace3-5e8fb72d0276 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52" status: 404 len: 111 microversion: 2.1 time: 0.062093 Nov 22 16:49:19.742446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 237/470] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:19 2021] GET /compute/v2.1/servers/9dc3b870-6198-463e-8ee9-b68bbb652e52 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:49:19.779658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:19.780772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:19.799022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:19.799251 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.802168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:19.802678 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:19.862215 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:49:19.863381 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:19.875435 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:19.877315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:19.882211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d0789ff9-8b77-42ac-9d87-af01966b6893 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.397679 Nov 22 16:49:19.897361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 234/471] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:19 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:20.082262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:20.084156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:20.101218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:20.104308 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:20.105581 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:20.107405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:20.261501 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3be239d4-9409-44cd-9ae7-8e73ff8c0848 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 204 len: 0 microversion: 2.1 time: 0.499752 Nov 22 16:49:20.268809 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 238/472] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:49:19 2021] DELETE /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:49:20.277120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:20.278338 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:20.288556 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:20.289355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:20.290684 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:20.291357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:20.629339 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:20.641674 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fba64b79-09de-4670-91e0-91ddfc883799 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1513 microversion: 2.1 time: 0.370750 Nov 22 16:49:20.642589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 239/473] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:20 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:20.688745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:20.700328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2d20b6ed-00ec-49c8-a61e-b8663c34573f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.622807 Nov 22 16:49:20.703721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 235/474] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:20 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:20.904106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:20.904717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:20.915584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:20.916097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:20.916895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:20.917328 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:21.179246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:21.191473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:21.193184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:21.194361 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0596d8c8-a469-4aec-96ed-a299a1a1454e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.293918 Nov 22 16:49:21.205371 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 240/475] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:20 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:21.661771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:21.662406 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:21.688315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:21.689062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:21.690473 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:21.691242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:21.726048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:21.727098 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:21.777350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:21.778392 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:21.781220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:21.782069 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:21.906756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:21.918200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-941c9075-8431-4ab8-b37c-fc1987d642ba tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1513 microversion: 2.1 time: 0.260031 Nov 22 16:49:21.928227 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 236/476] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:21 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1513 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:22.104671 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:22.120110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5bde965f-9f86-4f22-b0de-0a640843c4e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.402223 Nov 22 16:49:22.120989 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 241/477] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:21 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:22.212929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:22.214223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:22.221096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:22.221849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:22.222840 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:22.223588 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:22.498207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:22.523407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:22.526681 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:22.529624 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a478f548-455e-4298-9fb6-79e4e971dc30 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.319772 Nov 22 16:49:22.543297 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 237/478] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:22 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:22.948973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:22.949461 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:22.969554 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:22.970491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:22.972017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:22.972910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:23.142833 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:23.143471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:23.172493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:23.176652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:23.186555 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:23.187568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:23.271436 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:23.295691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-16a8dd4f-b7d9-4c01-b6b1-e5dfb3556b81 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1513 microversion: 2.1 time: 0.351696 Nov 22 16:49:23.327808 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 242/479] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:22 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:23.486504 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-b4968c0c-4317-448b-bb15-0569df82b800 req-39250166-1b45-48bd-abc5-6de05d7a7c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5a9920-9b57-4407-a8ec-81e482c17f40", "name": "network-vif-deleted", "tag": "f161f420-b2a8-4508-96f4-093c1147db59"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:23.489222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:49:23.489222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:49:23.518475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-b4968c0c-4317-448b-bb15-0569df82b800 req-39250166-1b45-48bd-abc5-6de05d7a7c99 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:23.519191 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-b4968c0c-4317-448b-bb15-0569df82b800 req-39250166-1b45-48bd-abc5-6de05d7a7c99 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:23.537643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-b4968c0c-4317-448b-bb15-0569df82b800 req-39250166-1b45-48bd-abc5-6de05d7a7c99 service nova] Creating event network-vif-deleted:f161f420-b2a8-4508-96f4-093c1147db59 for instance 5a5a9920-9b57-4407-a8ec-81e482c17f40 on hv-cinder-80473 Nov 22 16:49:23.555437 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-b4968c0c-4317-448b-bb15-0569df82b800 req-39250166-1b45-48bd-abc5-6de05d7a7c99 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072215 Nov 22 16:49:23.568268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 243/480] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:49:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:23.574578 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:23.582364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:23.595623 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:23.608493 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:23.609136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:23.610201 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:23.610800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:23.611096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8e87afd0-4428-4888-9de0-32d9b6381098 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.473097 Nov 22 16:49:23.612059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 238/481] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:23 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:24.076015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:24.102020 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:24.146865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:24.154067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-bd65de0c-b00e-4de1-976f-f1d36f506343 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.583904 Nov 22 16:49:24.200310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 244/482] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:23 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:24.337898 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:24.339630 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:24.369290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:24.371538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:24.379123 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:24.392665 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:24.497407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:24.498328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:24.498846 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lazy-loading 'fault' on Instance uuid 5a5a9920-9b57-4407-a8ec-81e482c17f40 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:24.552066 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:24.563468 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bc5acb1e-8297-4e36-8940-969103aa03f7 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 200 len: 1308 microversion: 2.1 time: 0.232692 Nov 22 16:49:24.564629 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 239/483] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:24 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:24.629611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:24.630538 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:24.645032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:24.646797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:24.651426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:24.655520 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:24.950204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:24.964623 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fe69fdfd-772d-4cdc-8654-97ae29a1fbaf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.338496 Nov 22 16:49:24.977627 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 245/484] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:24 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:25.175731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:25.176405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:25.183770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:25.184688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:25.185716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:25.186632 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:25.396267 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:25.410651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:25.417696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:25.419135 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f7cefe63-3f13-49f7-9479-db5ba3fed774 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.248072 Nov 22 16:49:25.419969 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 240/485] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:25 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:25.589489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:25.590418 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 5a5a9920-9b57-4407-a8ec-81e482c17f40] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:25.608064 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:25.608814 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:25.609779 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:25.610366 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:25.631884 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] HTTP exception thrown: Instance 5a5a9920-9b57-4407-a8ec-81e482c17f40 could not be found. Nov 22 16:49:25.633300 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Returning 404 to user: Instance 5a5a9920-9b57-4407-a8ec-81e482c17f40 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:49:25.634401 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-32c3b6c6-9c3f-4a3b-bcc7-28a99442d46f tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40" status: 404 len: 111 microversion: 2.1 time: 0.051896 Nov 22 16:49:25.636057 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 246/486] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:25 2021] GET /compute/v2.1/servers/5a5a9920-9b57-4407-a8ec-81e482c17f40 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:49:25.998425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:26.000057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:26.023094 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:26.023941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:26.036447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:26.037782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:26.297405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:26.310370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-65cabb61-2e60-487d-8ec6-6e2b29ecd1ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.318570 Nov 22 16:49:26.311072 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 241/487] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:25 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:26.445923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:26.446539 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:26.472800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:26.474332 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:26.475939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:26.478542 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:26.793755 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:26.807699 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:26.809580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:26.810983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-73313122-8b7b-484b-b9b1-87a258865f67 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1740 microversion: 2.20 time: 0.371448 Nov 22 16:49:26.811528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 247/488] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:26 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1740 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:26.860322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:26.861505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:26.869646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:26.870252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:26.871097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:26.871535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:26.916596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:49:27.034889 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-848d8e66-a8e3-4ad7-a4b3-263fc1fd69f9 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "DELETE /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 204 len: 0 microversion: 2.1 time: 0.179753 Nov 22 16:49:27.036794 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 242/489] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:49:26 2021] DELETE /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:49:27.046975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:27.050297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:27.060213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:27.060770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:27.061887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:27.062499 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:27.251302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:27.259620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-346a9cdb-0f99-4e5b-98ad-9e8e2235b991 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1514 microversion: 2.1 time: 0.218046 Nov 22 16:49:27.260237 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 248/490] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:27 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:27.340040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:27.340835 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:27.347906 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:27.349593 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:27.350689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:27.351327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:27.530784 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:27.540980 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e8ecf999-9b6f-4f6e-913c-10e321c000f5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.205337 Nov 22 16:49:27.541562 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 243/491] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:27 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:27.828842 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:27.829443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:27.836439 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:27.836881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:27.837664 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:27.838096 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:28.019175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:28.033716 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:28.035710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:28.038525 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0ed2ad34-7f16-41b5-b869-4c825400c22b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1722 microversion: 2.20 time: 0.213284 Nov 22 16:49:28.039683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 249/492] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:27 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:28.294061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:28.295027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:28.304891 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:28.309398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:28.310974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:28.311709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:28.502066 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:28.512862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ce4b8d01-0097-44a6-9aaf-9110a512f430 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1514 microversion: 2.1 time: 0.229898 Nov 22 16:49:28.513757 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 244/493] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:28 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1514 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:28.560286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:28.561097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:28.567204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:28.568562 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:28.569411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:28.569855 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:28.830345 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:28.859711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-73554b44-642b-41ae-9d1d-5cfd97d7fc2c tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.303979 Nov 22 16:49:28.860363 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 250/494] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:28 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:29.061409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:29.062613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:29.074960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:29.075702 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:29.077426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:29.079894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:29.257802 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:29.271408 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:29.273682 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:29.275407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6e0a5e4c-2dee-41ec-b06a-8925c4ed870b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1722 microversion: 2.20 time: 0.219119 Nov 22 16:49:29.276446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 245/495] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:29 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:29.532194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:29.532812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:29.541172 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:29.542018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:29.543120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:29.543660 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:29.737117 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:29.745943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-80520179-cac5-470a-9374-84e0eec770dc tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1514 microversion: 2.1 time: 0.218099 Nov 22 16:49:29.747138 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 251/496] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:29 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:29.885485 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:29.886326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:29.894074 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:29.894635 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:29.895752 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:29.896363 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:30.157264 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:30.172855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2d1e13c0-519e-48dd-acfc-216400ab8f78 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1568 microversion: 2.1 time: 0.292158 Nov 22 16:49:30.173403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 246/497] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:29 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:30.307730 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:30.312039 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:30.342776 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:30.343580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:30.349031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:30.354873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:30.665420 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:30.687956 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:30.693330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:30.696667 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-573c8f1e-7e41-4e09-a377-238e86c849cd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1722 microversion: 2.20 time: 0.397537 Nov 22 16:49:30.698361 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 252/498] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:30 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1722 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:30.769587 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:30.774681 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:30.797230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:30.808612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:30.822294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-39914bbb-a0c6-46d5-a1c9-6ffc61005e08 req-36af93fa-fb86-492d-b47f-ee0fb29fb849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46aaa1f5-cd61-46b1-9424-8444b96c948e", "name": "network-vif-deleted", "tag": "948e5c76-68b7-441c-b331-9380ea7a34e2"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:30.824753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:30.825083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:49:30.825083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:49:30.828627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:30.837507 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-39914bbb-a0c6-46d5-a1c9-6ffc61005e08 req-36af93fa-fb86-492d-b47f-ee0fb29fb849 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:30.838332 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-39914bbb-a0c6-46d5-a1c9-6ffc61005e08 req-36af93fa-fb86-492d-b47f-ee0fb29fb849 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:30.873620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-39914bbb-a0c6-46d5-a1c9-6ffc61005e08 req-36af93fa-fb86-492d-b47f-ee0fb29fb849 service nova] Creating event network-vif-deleted:948e5c76-68b7-441c-b331-9380ea7a34e2 for instance 46aaa1f5-cd61-46b1-9424-8444b96c948e on hv-cinder-80473 Nov 22 16:49:30.889792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-39914bbb-a0c6-46d5-a1c9-6ffc61005e08 req-36af93fa-fb86-492d-b47f-ee0fb29fb849 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070501 Nov 22 16:49:30.892189 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 253/499] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:49:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:30.962571 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7fd3afd3c5c48998728927ac2874231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d4f105bf7f47a8a530e61cecdb8ef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:30.984066 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a231dd5e-ceb9-4261-8a9e-c4b3469cacf5 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 200 len: 1472 microversion: 2.1 time: 0.220235 Nov 22 16:49:30.985550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 247/500] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:30 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:31.202787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:31.204019 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:31.219337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.220079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.222410 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.223135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.480444 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:31.497084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5a5c3191-b2a8-440e-902a-ce6facd5a4f6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1548 microversion: 2.1 time: 0.301864 Nov 22 16:49:31.512504 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 254/501] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:31 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1548 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:31.518464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:31.518944 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:31.529634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.530806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.532137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.532755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.641034 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-55786103-f73d-4689-9b0d-bc1224b1e6e8 req-86176ec0-2726-46f7-98e2-b67ba8515923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "name": "network-vif-unplugged", "status": "completed", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:31.644170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:49:31.644170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:49:31.672502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-55786103-f73d-4689-9b0d-bc1224b1e6e8 req-86176ec0-2726-46f7-98e2-b67ba8515923 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.684645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-55786103-f73d-4689-9b0d-bc1224b1e6e8 req-86176ec0-2726-46f7-98e2-b67ba8515923 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.717982 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] HTTP exception thrown: Cannot 'detach_volume' instance a3997288-5b3f-4013-bcad-f59ce5f32db3 while it is in vm_state rescued Nov 22 16:49:31.718989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Returning 409 to user: Cannot 'detach_volume' instance a3997288-5b3f-4013-bcad-f59ce5f32db3 while it is in vm_state rescued {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:49:31.720413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-49d25612-3c8e-4502-9e1e-4b6ac16c7641 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments/6f5b7b3f-4c2f-4415-8e56-7e7849bfcff3" status: 409 len: 152 microversion: 2.1 time: 0.206982 Nov 22 16:49:31.721287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 248/502] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:49:31 2021] DELETE /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments/6f5b7b3f-4c2f-4415-8e56-7e7849bfcff3 => generated 152 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 22 16:49:31.725742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-55786103-f73d-4689-9b0d-bc1224b1e6e8 req-86176ec0-2726-46f7-98e2-b67ba8515923 service nova] Creating event network-vif-unplugged:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:49:31.734240 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:31.734889 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:31.740853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-55786103-f73d-4689-9b0d-bc1224b1e6e8 req-86176ec0-2726-46f7-98e2-b67ba8515923 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105137 Nov 22 16:49:31.742720 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 255/503] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:49:31 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:31.742948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.743199 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.744373 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.744823 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.764325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:31.766096 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:31.776275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.777378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.778593 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.779368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.906689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8da1beb9-f855-4f76-a8fa-67ad25f757ae tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action" status: 202 len: 0 microversion: 2.1 time: 0.160503 Nov 22 16:49:31.908110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 256/504] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:49:31 2021] POST /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:49:31.952397 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:31.953147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:31.973202 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.973878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:31.974907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:31.975423 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:32.140144 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:32.166676 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:32.169646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:32.173335 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d0bee7bf-4c41-4475-8ccd-40e7913f2875 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1722 microversion: 2.20 time: 0.444985 Nov 22 16:49:32.188971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 249/505] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:31 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1722 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:32.201745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:32.203232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] [instance: 46aaa1f5-cd61-46b1-9424-8444b96c948e] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:32.214240 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:32.215405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:32.217456 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:32.218424 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:32.243902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] HTTP exception thrown: Instance 46aaa1f5-cd61-46b1-9424-8444b96c948e could not be found. Nov 22 16:49:32.245517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] Returning 404 to user: Instance 46aaa1f5-cd61-46b1-9424-8444b96c948e could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:49:32.248071 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8473b8ae-49f7-4021-9e85-9ce87198af08 tempest-AttachVolumeNegativeTest-1703532779 tempest-AttachVolumeNegativeTest-1703532779-project] 10.222.0.61 "GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e" status: 404 len: 111 microversion: 2.1 time: 0.056271 Nov 22 16:49:32.249061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 250/506] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:32 2021] GET /compute/v2.1/servers/46aaa1f5-cd61-46b1-9424-8444b96c948e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:49:32.392084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:32.402887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5072c3b8-7790-435c-8e7b-6fe57edd9997 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1556 microversion: 2.1 time: 0.470236 Nov 22 16:49:32.403880 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 257/507] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:31 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1556 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:33.205403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:33.206555 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:33.218493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:33.219630 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:33.221407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:33.222321 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:33.427265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:33.436183 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:33.462557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:33.463269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:33.465061 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:33.465722 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:33.710725 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:33.724412 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:33.740481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:33.740481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9b02f08f-dba9-4b33-a0ff-587cb1f04b17 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1665 microversion: 2.20 time: 0.539619 Nov 22 16:49:33.761856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 251/508] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:33 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1665 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:33.769106 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eeefe471-da1d-4e2e-be3e-02299a944033"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:33.773062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:33.781372 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:33.782438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:33.784942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:33.785657 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:33.827265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:33.845957 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f299aa42-d51b-4b70-9939-2191e2ff18d7 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1556 microversion: 2.1 time: 0.425681 Nov 22 16:49:33.861212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 258/509] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:33 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1556 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:34.048080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4267494-8289-4f14-81ed-4789d2772edf", "device": "/dev/sdb"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:34.055441 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:34.075273 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:34.076528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:34.078286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:34.079360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:34.477928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ce0f7a86-1fe9-44c8-aaef-e1638751efe0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.713964 Nov 22 16:49:34.481967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 252/510] 10.222.0.61 () {62 vars in 1363 bytes} [Mon Nov 22 16:49:33 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments => generated 188 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:49:34.619362 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-357bfd3c-c512-46bc-9885-441d7c863bf4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "POST /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.589569 Nov 22 16:49:34.651680 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 259/511] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:49:34 2021] POST /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36/os-volume_attachments => generated 194 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:34.808504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:49:34.810128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:34.829943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:34.831250 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:34.832585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:34.833508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:34.876017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:34.880078 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:34.891954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:34.892964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:34.894551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:34.896388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:35.079465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bdebafa9-c443-4a6f-bd8f-b96efc4b8fea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action" status: 202 len: 0 microversion: 2.20 time: 0.278822 Nov 22 16:49:35.085907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 253/512] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:49:34 2021] POST /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:49:35.097367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:35.098126 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:35.122645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:35.123117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:35.123959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:35.124438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:35.308466 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:35.336141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8d607d52-c130-4d1d-80d0-3d4a00cfb574 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1556 microversion: 2.1 time: 0.465920 Nov 22 16:49:35.337953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 260/513] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:34 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1556 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:35.502912 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:35.522796 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:35.526487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:35.529276 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-31e46f0b-d60a-49da-910d-5188daf85f7b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1751 microversion: 2.20 time: 0.442047 Nov 22 16:49:35.530702 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 254/514] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:35 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1751 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:36.358596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:36.359600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:36.376982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:36.377445 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:36.378419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:36.378866 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:36.562679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:36.563500 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:36.572624 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:36.574866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:36.577849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:36.578383 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:36.658305 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:36.669179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-48d38f11-62f3-4a48-9824-6c45fc2924be tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1556 microversion: 2.1 time: 0.316403 Nov 22 16:49:36.671151 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 261/515] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:36 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1556 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:36.889413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:36.903163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:36.905568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:36.907284 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-13ffbcd9-6c80-4ce5-8f37-e8398904fcff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1751 microversion: 2.20 time: 0.348669 Nov 22 16:49:36.908431 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 255/516] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:36 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1751 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:37.691943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:37.694005 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:37.709913 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:37.710612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:37.711871 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:37.712577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:37.932391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:37.962569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:37.991190 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:37.992548 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:37.994293 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:37.996721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:38.125032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:38.134986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-44a6ebb8-63ee-484c-b805-04f618e972b6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1556 microversion: 2.1 time: 0.448122 Nov 22 16:49:38.136490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 262/517] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:37 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1556 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:38.338561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:38.350727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:38.352609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:38.368190 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a2479b7d-4fb8-49bc-a513-82c748c0869a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.437244 Nov 22 16:49:38.369003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 256/518] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:37 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:39.154765 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:39.155390 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:39.171629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:39.172099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:39.173194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:39.173573 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:39.390399 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a5f1fe1e-7931-459a-956a-479b4f71e0c7 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695ad7280>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:39.403364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:39.431738 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-13ec325d-90f9-4e8c-8ecb-94509079d632 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1562 microversion: 2.1 time: 0.281094 Nov 22 16:49:39.438848 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 263/519] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:49:39 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1562 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:39.453014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:39.457062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:39.477795 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:39.478356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:39.479680 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:39.484073 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:39.496747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a5f1fe1e-7931-459a-956a-479b4f71e0c7 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6f1507f6-441c-416a-ba49-98b45a434e92" status: 200 len: 348 microversion: 2.1 time: 0.111064 Nov 22 16:49:39.497775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 257/520] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:49:39 2021] GET /compute/v2.1/os-volumes/6f1507f6-441c-416a-ba49-98b45a434e92 => generated 348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:39.605109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:39.606327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:39.616816 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:39.617958 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:39.619937 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:39.621312 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:39.696586 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:39.712538 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:39.714820 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:39.716423 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4c670bf0-e6b9-475d-a280-ed2f81e0573a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.275568 Nov 22 16:49:39.717187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 264/521] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:39 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:40.025482 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lazy-loading 'services' on Instance uuid a3997288-5b3f-4013-bcad-f59ce5f32db3 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:49:40.150903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-83ef8e2f-0cd9-4974-902b-d341a14b87b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments/6f5b7b3f-4c2f-4415-8e56-7e7849bfcff3" status: 202 len: 0 microversion: 2.1 time: 0.553159 Nov 22 16:49:40.151750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 258/522] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:49:39 2021] DELETE /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments/6f5b7b3f-4c2f-4415-8e56-7e7849bfcff3 => generated 0 bytes in 555 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:49:40.161929 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:40.163944 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:40.177662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:40.178450 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:40.179911 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:40.180657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:40.240637 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1ab695cd-8f12-489e-a67b-253beb1640d4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084217 Nov 22 16:49:40.241695 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 265/523] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:40 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:40.741431 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:40.743355 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:40.752609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:40.753657 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:40.754971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:40.756092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:40.972694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:40.986635 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:40.988342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:40.990110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8c8b82ca-72e5-474f-aeaa-539f7d901a14 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.257027 Nov 22 16:49:40.990846 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 259/524] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:40 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:41.161583 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4c9a9686-fde7-40a4-8190-737b7fb13687 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc69539da60>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:41.214133 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4c9a9686-fde7-40a4-8190-737b7fb13687 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/9d1b4e4f-2bb0-4c33-b7e3-5e6e9988b545" status: 200 len: 350 microversion: 2.1 time: 0.056656 Nov 22 16:49:41.215122 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 266/525] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:49:41 2021] GET /compute/v2.1/os-volumes/9d1b4e4f-2bb0-4c33-b7e3-5e6e9988b545 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:41.255550 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:41.256830 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:41.264506 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:41.265221 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:41.266266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:41.266746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:41.314651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ab069081-27c3-45c2-ae28-1e2057e14886 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064046 Nov 22 16:49:41.314997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 260/526] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:41 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:49:42.011675 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:42.013339 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:42.023110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:42.023570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:42.024517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:42.024958 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:42.188346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:42.200729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:42.203634 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:42.215489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-29ce6841-27b2-4724-8375-3f3531867f1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.207907 Nov 22 16:49:42.216585 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 267/527] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:42 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:42.340805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:42.344241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:42.365277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:42.366384 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:42.368124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:42.369110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:42.440862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d2392e8f-bc2a-443f-847c-9fc26f03989f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114344 Nov 22 16:49:42.441815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 261/528] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:42 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:42.674724 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-18625b57-0136-4624-b3ea-fb272cb06af0 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc69539d820>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:42.740777 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-18625b57-0136-4624-b3ea-fb272cb06af0 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/334677fd-c737-449e-86fa-fe4609a719c8" status: 200 len: 351 microversion: 2.1 time: 0.070167 Nov 22 16:49:42.741636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 268/529] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:49:42 2021] GET /compute/v2.1/os-volumes/334677fd-c737-449e-86fa-fe4609a719c8 => generated 351 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:42.756999 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9d7cf7ba-1e23-41ef-9155-437ce6772482 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695a9cc10>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:42.848669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9d7cf7ba-1e23-41ef-9155-437ce6772482 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.098257 Nov 22 16:49:42.849579 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 262/530] 10.222.0.61 () {58 vars in 1133 bytes} [Mon Nov 22 16:49:42 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:42.862754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-78ffe5bb-9f38-48a7-a12a-be4f97e81cfe tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695344670>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:42.954062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-78ffe5bb-9f38-48a7-a12a-be4f97e81cfe tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095189 Nov 22 16:49:42.954670 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 269/531] 10.222.0.61 () {58 vars in 1148 bytes} [Mon Nov 22 16:49:42 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:42.967072 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b4a81d7d-16cd-477f-9ee3-ff91bea95a42 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695ad7e50>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.063416 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b4a81d7d-16cd-477f-9ee3-ff91bea95a42 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.099965 Nov 22 16:49:43.064146 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 263/532] 10.222.0.61 () {58 vars in 1133 bytes} [Mon Nov 22 16:49:42 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:43.076909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-38540347-99bc-40d3-89fb-6b7d667134d2 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695de9af0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.162443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-38540347-99bc-40d3-89fb-6b7d667134d2 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089194 Nov 22 16:49:43.163212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 270/533] 10.222.0.61 () {58 vars in 1166 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:43.174483 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0ce9bcd4-e6a5-4880-b93d-b4764180ff6e tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695b4f280>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.235519 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.236469 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:43.242995 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:43.243439 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:43.244262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:43.244697 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:43.264030 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0ce9bcd4-e6a5-4880-b93d-b4764180ff6e tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092951 Nov 22 16:49:43.264602 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 264/534] 10.222.0.61 () {58 vars in 1169 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:43.279722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ebd9093d-d438-4faa-bed7-8d55b9e013a4 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695b4fe50>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.415086 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:43.417204 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ebd9093d-d438-4faa-bed7-8d55b9e013a4 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.143160 Nov 22 16:49:43.430518 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:43.431486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:43.431693 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 265/535] 10.222.0.61 () {58 vars in 1154 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:49:43.434093 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b4398e6a-0fd4-499e-a874-0f0a2df4c634 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.202673 Nov 22 16:49:43.448376 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-72accfc1-12ea-4193-beac-7b73783ef4c1 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc695ad74c0>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.449609 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 271/536] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:43.456378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.457300 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:43.470368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:43.471335 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:43.472906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:43.474420 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:43.536628 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b8a11a2a-270b-45a5-bce3-67851425bcf1 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084860 Nov 22 16:49:43.537873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 272/537] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:43.587878 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-72accfc1-12ea-4193-beac-7b73783ef4c1 tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.151795 Nov 22 16:49:43.589401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 266/538] 10.222.0.61 () {58 vars in 1187 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:43.604172 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f539cf7a-4a25-4144-b97c-c3f4bbf5df6b tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] Calling method '.version_select at 0x7fc69539d3a0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:43.693476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f539cf7a-4a25-4144-b97c-c3f4bbf5df6b tempest-VolumesTestJSON-178666118 tempest-VolumesTestJSON-178666118-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.092540 Nov 22 16:49:43.693933 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 273/539] 10.222.0.61 () {58 vars in 1154 bytes} [Mon Nov 22 16:49:43 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:49:44.462739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:44.463610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:44.470704 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:44.471582 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:44.472805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:44.473534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:44.557248 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:44.558850 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:44.588351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:44.591571 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:44.593476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:44.594442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:44.664637 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-56165204-a9b2-42ef-b573-1debd24d8f89 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118555 Nov 22 16:49:44.665536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 274/540] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:44 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:44.710093 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:44.725043 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:44.726879 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:44.728320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-16de5b1c-9014-4db0-ba2b-9a78c9977f10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.272248 Nov 22 16:49:44.729053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 267/541] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:44 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:45.677352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:45.678335 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:45.685907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:45.686351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:45.687153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:45.687580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:45.737796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4e3121f1-5b67-4daa-8b4b-ffdd3b3596bf tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065364 Nov 22 16:49:45.738378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 275/542] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:45 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:45.752504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:45.753323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:45.761509 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:45.762007 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:45.762857 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:45.763344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:45.920493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:45.934370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:45.937319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:45.939475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d0583e91-a6ad-4da6-b956-a49be30014e2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.190462 Nov 22 16:49:45.940477 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 268/543] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:45 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:46.756993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:46.758900 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:46.771104 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:46.777630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:46.777630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:46.777630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:46.825650 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-643cb1f5-7f02-4620-b624-0c69cf8dbaf9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077752 Nov 22 16:49:46.826367 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 276/544] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:46 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:46.972156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:46.973585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:46.984184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:46.984851 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:46.985807 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:46.986240 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:47.140979 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:47.154612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:47.157792 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:47.159811 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-856f0141-2211-4220-8b02-5b5616f0935f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.194054 Nov 22 16:49:47.160902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 269/545] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:46 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:47.840682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:47.841530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:47.848036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:47.848690 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:47.849655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:47.852983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:47.883127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5900d49b-3845-41ca-937a-e83b3df723e5 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049217 Nov 22 16:49:47.883689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 277/546] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:47 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:48.180136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:48.180755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:48.187336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:48.187776 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:48.188586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:48.189037 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:48.372815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:48.381826 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:48.383413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:48.384658 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6a5e2d07-8dbd-4062-a85f-45a8f753018a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.208835 Nov 22 16:49:48.385217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 270/547] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:48 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:48.895394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:48.896383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:48.903116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:48.903618 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:48.904464 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:48.904899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:48.938969 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-558dd4db-b6e8-4355-a5ea-7b55a6ee69ab tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047843 Nov 22 16:49:48.939640 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 278/548] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:48 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:49.406731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:49.407805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:49.415555 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:49.416124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:49.417134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:49.417659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:49.567440 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:49.576856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:49.578805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:49.580524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-23a19701-0cc1-4072-b470-4a512c202f1a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1753 microversion: 2.20 time: 0.179092 Nov 22 16:49:49.581356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 271/549] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:49 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:49.952677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:49.953607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:49.960673 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:49.961127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:49.961920 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:49.962353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:49.995288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4cce4e64-5527-48c4-87fa-6069c9d113c6 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Nov 22 16:49:49.995862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 279/550] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:49 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:50.599907 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:50.600689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:50.606579 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:50.607020 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:50.607804 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:50.608276 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:50.755077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:50.764124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:50.765701 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:50.767207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6c93120f-794d-40e8-bba1-7faf05af926d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.171759 Nov 22 16:49:50.776097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 272/551] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:50 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:51.007812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:51.008753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:51.016131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:51.016582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:51.017398 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:51.017825 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:51.056618 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e893eb87-c4b0-49d6-8103-e6b38d1f2b5f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053208 Nov 22 16:49:51.060045 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 280/552] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:51 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:49:51.787575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:51.788480 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:51.794189 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:51.794637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:51.795422 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:51.795883 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:51.940097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:51.957863 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:51.960055 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:51.961299 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-08110376-88c9-449a-ac31-409cf5cddfea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.178714 Nov 22 16:49:51.961924 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 273/553] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:51 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:52.069010 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:52.070272 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:52.077320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:52.077902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:52.078867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:52.079403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:52.111742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-eda98843-659a-448d-9d81-918e8e1a9813 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047220 Nov 22 16:49:52.112604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 281/554] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:49:52 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:49:52.979838 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:52.980448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:52.986833 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:52.987283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:52.988094 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:52.988633 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:53.140402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:53.149840 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:53.151330 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:53.152512 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e4ef1c6b-965f-428d-bfee-b407812ecaff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.176390 Nov 22 16:49:53.153074 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 274/555] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:52 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:49:54.172100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:54.172690 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:54.180621 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:54.181220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:54.182385 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:54.182849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:54.368046 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:54.377413 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:54.378983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:54.380420 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6a35b0f1-8f65-47a8-9db7-7cd40e454b4e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.212320 Nov 22 16:49:54.381083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 282/556] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:54 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:55.411793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:55.416785 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:55.429563 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:55.436801 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:55.438061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:55.438715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:55.608099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:55.618237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:55.621953 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:55.623577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-341d4746-fb2a-4257-99ce-76756dcb18b3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.218150 Nov 22 16:49:55.624208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 275/557] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:55 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:56.355951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 16:49:56.356516 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 16:49:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 16:49:56.646125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:56.647232 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:56.656404 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:56.657110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:56.658152 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:56.658793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:56.942806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:56.952361 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:56.954076 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:56.955530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-90777cc2-1fe7-43d8-924f-ddce95574107 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.315503 Nov 22 16:49:56.969369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 283/558] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:56 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:57.976277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:57.977050 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:57.983987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:57.984430 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:57.985320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:57.985651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:58.322789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:58.360493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:58.365427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:58.367629 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5dbee37e-5273-4e59-a223-d1a512e1266a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.395477 Nov 22 16:49:58.368739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 276/559] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:57 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:59.401032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:59.402390 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:59.410854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:59.411614 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:59.412828 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:59.413381 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:59.607617 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:59.618435 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:59.619651 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:49:59.621128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f3db869d-fe9a-4323-9c61-434fd71668bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.226967 Nov 22 16:49:59.622264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 284/560] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:49:59 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:49:59.929053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:49:59.933374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:49:59.941380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:59.942368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:59.943916 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:49:59.944863 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:49:59.981679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:50:00.181797 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cefdf494-af90-4f2a-9a5c-9a1e35a12b98 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "DELETE /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 204 len: 0 microversion: 2.1 time: 0.257955 Nov 22 16:50:00.181797 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 277/561] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:49:59 2021] DELETE /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:50:00.190659 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:00.192372 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:00.199290 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:00.200112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:00.201108 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:00.201792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:00.392866 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:00.402205 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-37660d42-0a8a-4150-a9fa-7e2df86a9d8e tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.215546 Nov 22 16:50:00.404357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 285/562] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:00 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:00.643002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:00.644174 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:00.651808 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:00.652281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:00.653068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:00.653509 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:00.895611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:00.921067 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:00.931427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:00.933634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d289c233-eba3-4654-be67-ffb99a2cf743 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.295227 Nov 22 16:50:00.934814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 278/563] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:00 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:01.426428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:01.428103 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:01.469856 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:01.471974 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:01.477083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:01.477849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:01.877650 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:01.892653 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-df772730-9a13-4aec-9074-ecc7d3822d2d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.471082 Nov 22 16:50:01.894877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 286/564] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:01 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:01.954058 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:01.956447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:01.966496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:01.968303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:01.970442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:01.971931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:02.159775 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:02.231268 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:02.236286 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:02.242524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4229a800-15e7-4a48-988d-84043f389583 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.292438 Nov 22 16:50:02.247334 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 279/565] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:01 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:02.916412 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:02.917607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:02.932356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:02.933701 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:02.935526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:02.936584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:03.228727 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:03.239558 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2a9cade2-42a2-4cd8-bd2b-bc3816ed1914 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.331361 Nov 22 16:50:03.250359 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 287/566] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:02 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:03.267540 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:03.268704 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:03.296269 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:03.297232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:03.299263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:03.300528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:03.631915 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:03.653450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:03.659484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:03.662174 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4b95a6c4-75a8-49a9-a356-7324995be159 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.397800 Nov 22 16:50:03.664080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 280/567] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:03 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:03.996073 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:03.996787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:04.040419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:04.040865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:04.041683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:04.042119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:04.205190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lazy-loading 'services' on Instance uuid 2c904c32-a712-42f3-b763-fc8092114b36 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:50:04.263345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:04.264770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:04.275126 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:04.277058 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:04.278557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:04.279200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:04.352486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e643283f-3e6d-4bfa-b6f3-aa771e251573 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36/os-volume_attachments/c4267494-8289-4f14-81ed-4789d2772edf" status: 202 len: 0 microversion: 2.1 time: 0.361504 Nov 22 16:50:04.353976 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 288/568] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:50:03 2021] DELETE /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36/os-volume_attachments/c4267494-8289-4f14-81ed-4789d2772edf => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:50:04.534692 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:04.545471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c1459f64-3bb5-4d1d-a29e-aef5ccc560ff tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.289681 Nov 22 16:50:04.546642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 281/569] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:04 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:04.682620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:04.683677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:04.691037 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:04.692087 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:04.694595 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:04.695235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:04.991078 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:05.009921 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:05.015865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:05.020553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4f9860c0-4622-47d2-983e-e613b4aa2d47 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.340281 Nov 22 16:50:05.031688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 289/570] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:04 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:05.581605 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:05.583708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:05.594325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:05.594778 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:05.596290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:05.596290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:05.785025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:05.793700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-089ce8ca-f861-4043-ad5b-1b7da4fedadd tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.224461 Nov 22 16:50:05.804368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 282/571] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:05 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:06.053584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:06.055099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:06.063031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:06.064442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:06.065317 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:06.065761 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:06.302686 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:06.318497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:06.321776 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:06.324368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-13b2c0bc-13a5-4902-aa85-d4bcdbea8eeb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.276136 Nov 22 16:50:06.328834 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 290/572] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:06 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:06.811028 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:06.811984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:06.820855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:06.820855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:06.821226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:06.823789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:06.997428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:07.011847 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6d667f59-a0f2-4693-b320-d066eb447b38 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.204671 Nov 22 16:50:07.012663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 283/573] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:06 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:07.347283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:07.349236 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:07.355798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:07.356272 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:07.357060 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:07.357518 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:07.558740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:07.572018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:07.573574 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:07.575064 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5f947e56-a9cb-4720-b199-4450795118b5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.232223 Nov 22 16:50:07.575899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 291/574] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:07 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:07.725857 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:07.726507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:07.733814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:07.734435 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:07.735191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:07.735647 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:07.779170 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:50:07.884910 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0dd90c01-fa46-409b-83a7-dc1d10a7b949 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 204 len: 0 microversion: 2.1 time: 0.168154 Nov 22 16:50:07.885791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 284/575] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:50:07 2021] DELETE /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:50:07.894350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:07.894967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:07.909675 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:07.911287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:07.912591 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:07.913167 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:08.030969 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:08.031709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:08.038532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:08.038990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:08.040132 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:08.040253 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:08.123469 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:08.133663 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a338b29f-6fc3-49c7-a95b-00843ab844a0 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1513 microversion: 2.1 time: 0.243074 Nov 22 16:50:08.134916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 292/576] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:07 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:08.233997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:08.243344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4634537d-39a8-4e6b-8a99-7acedadc8805 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.216524 Nov 22 16:50:08.244031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 285/577] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:08 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:08.603891 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:08.604696 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:08.612725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:08.612725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:08.613679 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:08.614122 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:08.851259 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:08.862047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:08.862570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:08.863506 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3d4f98b9-fcab-4ab3-867f-1690442b4e7a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.272233 Nov 22 16:50:08.864246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 293/578] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:08 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:09.162283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:09.163412 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:09.176507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:09.177333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:09.178444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:09.179035 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:09.267807 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:09.269219 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:09.280017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:09.280559 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:09.281443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:09.281955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:09.446433 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:09.455782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b45e8d23-40b9-4ae7-b30b-b148f865f697 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1513 microversion: 2.1 time: 0.300674 Nov 22 16:50:09.457959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 286/579] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:09 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:09.512652 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:09.521722 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-76597cfb-e831-48c6-849a-f50664003c3f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1507 microversion: 2.1 time: 0.261137 Nov 22 16:50:09.526535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 294/580] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:09 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:09.888732 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:09.890056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:09.901273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:09.902229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:09.903845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:09.904665 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.107923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:10.118545 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:10.120319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:10.122819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ae16f391-ff92-49ff-a2e9-dea918ebdfd5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.240331 Nov 22 16:50:10.123671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 287/581] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:09 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:10.386291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-61f53037-5ed6-49aa-8f51-f2448375b966 req-7781ce74-39b6-41ff-bb2c-bd5e194d7716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286a87c0-cd89-4f83-8b58-a8ee9f2636b3", "name": "network-vif-deleted", "tag": "c2cb7311-7775-45f5-a309-0e88da36762b"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:10.388126 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:10.388126 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:10.398735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-61f53037-5ed6-49aa-8f51-f2448375b966 req-7781ce74-39b6-41ff-bb2c-bd5e194d7716 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:10.400231 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-61f53037-5ed6-49aa-8f51-f2448375b966 req-7781ce74-39b6-41ff-bb2c-bd5e194d7716 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.418170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-61f53037-5ed6-49aa-8f51-f2448375b966 req-7781ce74-39b6-41ff-bb2c-bd5e194d7716 service nova] Creating event network-vif-deleted:c2cb7311-7775-45f5-a309-0e88da36762b for instance 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 on hv-cinder-80473 Nov 22 16:50:10.426152 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-61f53037-5ed6-49aa-8f51-f2448375b966 req-7781ce74-39b6-41ff-bb2c-bd5e194d7716 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050044 Nov 22 16:50:10.427408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 295/582] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:10.475508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:10.476686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:10.483722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:10.484230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.485031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:10.485642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.543334 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:10.544869 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:10.559127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:10.560141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.576328 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:10.577479 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.637155 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:10.637726 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:10.639883 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lazy-loading 'fault' on Instance uuid 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:50:10.735444 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:10.752460 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-433c9d23-7d51-42cb-9de5-f626b901dbba tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 200 len: 1311 microversion: 2.1 time: 0.213574 Nov 22 16:50:10.758783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 296/583] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:10 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 1311 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:10.780487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:10.791179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-55b4e55c-d769-494e-b795-2437742d96b9 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 200 len: 1513 microversion: 2.1 time: 0.320005 Nov 22 16:50:10.791793 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 288/584] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:10 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:11.147490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:11.151802 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:11.164337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.165228 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.166882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.167688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.364293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:11.383427 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:11.383427 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:11.383907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-325f3c72-cf52-405c-bccc-754853e6b015 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.245960 Nov 22 16:50:11.384413 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 297/585] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:11 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:11.780173 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:11.781276 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: 286a87c0-cd89-4f83-8b58-a8ee9f2636b3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:11.792319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.793164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.794573 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.795370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.819764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] HTTP exception thrown: Instance 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 could not be found. Nov 22 16:50:11.820183 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:11.821095 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 2c904c32-a712-42f3-b763-fc8092114b36] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:11.821708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Returning 404 to user: Instance 286a87c0-cd89-4f83-8b58-a8ee9f2636b3 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:50:11.823067 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-db8d2678-fecc-40a8-9f0d-38a7230fc599 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3" status: 404 len: 111 microversion: 2.1 time: 0.049873 Nov 22 16:50:11.828652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 289/586] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:11 2021] GET /compute/v2.1/servers/286a87c0-cd89-4f83-8b58-a8ee9f2636b3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:50:11.831667 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.832174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.833008 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.833417 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.837228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:11.838009 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:11.847939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.848615 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.849909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:11.850583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:11.851310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] HTTP exception thrown: Instance 2c904c32-a712-42f3-b763-fc8092114b36 could not be found. Nov 22 16:50:11.852031 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Returning 404 to user: Instance 2c904c32-a712-42f3-b763-fc8092114b36 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:50:11.853083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-434e43dc-50c3-4e79-83cb-e43fb2c3878b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36" status: 404 len: 111 microversion: 2.1 time: 0.039992 Nov 22 16:50:11.855902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 298/587] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:11 2021] GET /compute/v2.1/servers/2c904c32-a712-42f3-b763-fc8092114b36 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 16:50:11.895593 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:50:12.037396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b300852a-0e63-4a57-97c9-5bbaf492d50a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 204 len: 0 microversion: 2.1 time: 0.206475 Nov 22 16:50:12.038225 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 290/588] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:50:11 2021] DELETE /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:50:12.047407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:12.048324 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:12.059075 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:12.060584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:12.062092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:12.063625 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:12.239966 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:12.249054 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8dfd32cd-4ea1-4bc0-b0df-a80fde63f37a tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.206421 Nov 22 16:50:12.249661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 299/589] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:12 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:12.404140 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:12.404751 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:12.416883 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:12.417443 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:12.418531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:12.418974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:12.454246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-85a20403-1b39-4ec7-9593-6b5935bac280 req-2f50dce6-8461-4efb-a76e-0612ecfa396b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c904c32-a712-42f3-b763-fc8092114b36", "name": "network-vif-deleted", "tag": "f9308e9c-c6a8-4400-800b-7b08a32aa7eb"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:12.460867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:12.460867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:12.481931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-85a20403-1b39-4ec7-9593-6b5935bac280 req-2f50dce6-8461-4efb-a76e-0612ecfa396b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:12.482763 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-85a20403-1b39-4ec7-9593-6b5935bac280 req-2f50dce6-8461-4efb-a76e-0612ecfa396b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:12.506709 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-85a20403-1b39-4ec7-9593-6b5935bac280 req-2f50dce6-8461-4efb-a76e-0612ecfa396b service nova] Creating event network-vif-deleted:f9308e9c-c6a8-4400-800b-7b08a32aa7eb for instance 2c904c32-a712-42f3-b763-fc8092114b36 on hv-cinder-80473 Nov 22 16:50:12.516219 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-85a20403-1b39-4ec7-9593-6b5935bac280 req-2f50dce6-8461-4efb-a76e-0612ecfa396b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068053 Nov 22 16:50:12.517063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 300/590] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:50:12.604017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:12.618738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:12.622136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:12.624633 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5770eee8-2ce8-4c9b-a579-31105a49d9f0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.224797 Nov 22 16:50:12.626006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 291/591] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:12 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:13.272395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:13.273181 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:13.280470 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:13.280971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:13.281973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:13.282464 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:13.446035 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:13.454805 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a4af5a07-329a-4a1e-8023-bea1affc2525 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.189669 Nov 22 16:50:13.455383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 301/592] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:13 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:13.650863 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:13.651611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:13.659850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:13.660865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:13.661877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:13.662747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:13.845209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:13.856216 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:13.857733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:13.858957 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-77045a29-3332-4a3d-88d6-ec6d99d81737 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.212322 Nov 22 16:50:13.859554 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 292/593] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:13 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:14.481080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:14.481080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:14.485161 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:14.485599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:14.486420 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:14.486909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:14.682384 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:14.690411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e02590c9-59e6-4d10-a978-16676a447b5d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.217457 Nov 22 16:50:14.691604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 302/594] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:14 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:14.882906 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:14.883631 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:14.890327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:14.890795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:14.891635 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:14.892115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:15.067598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:15.076771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:15.078282 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:15.079461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-75dc8fd8-cdf5-4a60-a311-dd351f52be23 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.203222 Nov 22 16:50:15.080063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 293/595] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:14 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:15.708186 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:15.708818 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:15.717346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:15.717888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:15.719174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:15.719682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:15.880692 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:15.891395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-81b54275-ae83-48ad-9bf0-85d7270263b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.186681 Nov 22 16:50:15.892237 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 303/596] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:15 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:16.100263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:16.100948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:16.107248 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:16.107782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:16.108617 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:16.109056 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:16.274487 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:16.289024 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:16.291589 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:16.293208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-fba0f4c9-4460-4580-bddd-111d0f6b0b3a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.197917 Nov 22 16:50:16.293958 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 294/597] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:16 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:16.915900 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:16.916694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:16.923371 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:16.923982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:16.924792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:16.925907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:17.116242 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:17.132079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-06800492-b574-421b-a4ef-6228f6f68fa4 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.222500 Nov 22 16:50:17.133037 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 304/598] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:16 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:17.320330 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:17.321046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:17.328524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:17.329012 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:17.329965 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:17.330430 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:17.523671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:17.533158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:17.535595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:17.536844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4f676a3c-5381-42fa-aad8-142c751dadce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.222094 Nov 22 16:50:17.537403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 295/599] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:17 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:17.694014 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-2c08ef33-5bb5-4ee3-b840-cee0b5d0657d req-eed611ab-8b73-4eea-afe0-6c97738bcc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "name": "network-vif-plugged", "status": "completed", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:17.696852 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:17.696852 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:17.714845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2c08ef33-5bb5-4ee3-b840-cee0b5d0657d req-eed611ab-8b73-4eea-afe0-6c97738bcc2d service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:17.715513 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2c08ef33-5bb5-4ee3-b840-cee0b5d0657d req-eed611ab-8b73-4eea-afe0-6c97738bcc2d service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:17.735481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-2c08ef33-5bb5-4ee3-b840-cee0b5d0657d req-eed611ab-8b73-4eea-afe0-6c97738bcc2d service nova] Creating event network-vif-plugged:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:50:17.741691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-2c08ef33-5bb5-4ee3-b840-cee0b5d0657d req-eed611ab-8b73-4eea-afe0-6c97738bcc2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053076 Nov 22 16:50:17.742305 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 305/600] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:50:18.149946 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:18.150556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:18.157675 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:18.158131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:18.158926 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:18.159362 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:18.352172 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:18.360516 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-436db990-f465-43e1-a6bc-2cfc14cd67b9 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.214010 Nov 22 16:50:18.361332 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 296/601] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:18 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:18.558418 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:18.559085 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:18.565661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:18.566107 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:18.566909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:18.567345 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:18.751794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:18.764393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:18.766911 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:18.769753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-815117a4-fe26-4865-9292-a64c24428c2a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.215523 Nov 22 16:50:18.771405 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 306/602] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:18 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:19.378260 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:19.378842 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:19.385384 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:19.385829 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:19.386625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:19.387052 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:19.555741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:19.566872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-dd14695e-7592-4185-8869-509264f6760d tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.191456 Nov 22 16:50:19.568432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 297/603] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:19 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:19.794489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:19.795290 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:19.802156 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:19.802619 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:19.804958 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:19.805417 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:19.974510 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:19.983661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:19.985300 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:19.986502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-da73db29-35b9-4296-aad4-e6ede7fb4c6d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.196066 Nov 22 16:50:19.987060 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 307/604] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:19 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:20.585470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:20.586139 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:20.593806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:20.594373 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:20.595332 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:20.595983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:20.767358 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:20.778805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0f56a8b3-9dff-47c2-97fe-ea955214e8b2 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.197389 Nov 22 16:50:20.779402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 298/605] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:20 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:21.006301 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:21.006918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:21.012945 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:21.013388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:21.014168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:21.014607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:21.177939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:21.193174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:21.194822 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:21.196070 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-70a6b65d-8abc-4125-accd-4c4d30678a1b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.194163 Nov 22 16:50:21.197503 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 308/606] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:21 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:21.803608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:21.804560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:21.811221 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:21.811678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:21.812520 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:21.812960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:21.995296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:22.003063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c43ce6b8-e390-4443-a0b0-c7709ce1914b tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.205212 Nov 22 16:50:22.004195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 299/607] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:21 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:22.060676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1019651218", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "networks": [{"uuid": "2a62bbf3-57d3-4911-b985-dd1a10a31d27"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:22.135246 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] validate_networks() for [('2a62bbf3-57d3-4911-b985-dd1a10a31d27', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:50:22.216415 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:22.217027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:22.225189 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:22.225860 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:22.226670 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:22.227102 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:22.487491 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:22.503442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:22.506581 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:22.509090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1df1b66e-4445-4bac-a00a-73a48750954d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.297205 Nov 22 16:50:22.510322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 300/608] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:22 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:50:22.653095 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:50:22.653763 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:50:22.654314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:50:22.654798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:50:22.655358 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:50:22.665387 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:22.665797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:22.666558 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:22.667000 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:22.684262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Getting quotas for project 1322235371824c2aba7f0fdaea4775f2. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:50:22.688774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Getting quotas for user 9a64bf88a7e446c0aa8e8aeb1bdadac3 and project 1322235371824c2aba7f0fdaea4775f2. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:50:22.701007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:50:22.703341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:50:22.754838 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8e4d26ff-b601-4bb7-867c-f1e5c9e9fa1b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697864 Nov 22 16:50:22.760931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 309/609] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:50:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 16:50:22.769648 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-da0a9ae4-384a-4445-bbde-80685556066e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:22.773833 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-da0a9ae4-384a-4445-bbde-80685556066e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:22.880737 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-da0a9ae4-384a-4445-bbde-80685556066e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:22.892478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-da0a9ae4-384a-4445-bbde-80685556066e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1219 microversion: 2.1 time: 0.129566 Nov 22 16:50:22.893473 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 301/610] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:22 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:23.024809 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:23.025860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:23.047988 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:23.049621 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:23.051584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:23.052418 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:23.221075 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:23.230078 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6b11fe3e-347e-4e9a-bccb-c98cd718480f tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1522 microversion: 2.1 time: 0.212407 Nov 22 16:50:23.230658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 310/611] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:23 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:23.530745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:23.531432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:23.540323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:23.540899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:23.542311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:23.543145 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:23.754765 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:23.763371 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:23.765092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:23.766451 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c638e5a9-7071-4b57-9579-affbd8ca04bf tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1809 microversion: 2.20 time: 0.239867 Nov 22 16:50:23.767512 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 302/612] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:23 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:23.912197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:23.912562 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:23.918758 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:23.919205 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:23.920059 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:23.920443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:23.984943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-9b96e718-4bad-47c0-9641-a19a87a48453 req-d95067f6-5035-4b4a-9f79-329cb558be37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3997288-5b3f-4013-bcad-f59ce5f32db3", "name": "network-vif-deleted", "tag": "dc6ce4e8-3940-405a-82fa-ee8b6d0fd6d3"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:23.991981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:23.991981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:50:24.000556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-9b96e718-4bad-47c0-9641-a19a87a48453 req-d95067f6-5035-4b4a-9f79-329cb558be37 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:24.001191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-9b96e718-4bad-47c0-9641-a19a87a48453 req-d95067f6-5035-4b4a-9f79-329cb558be37 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:24.002052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:24.012587 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-96d18cdb-22e6-45f7-b7c1-601b8fa613ec tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1271 microversion: 2.1 time: 0.104564 Nov 22 16:50:24.016088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-9b96e718-4bad-47c0-9641-a19a87a48453 req-d95067f6-5035-4b4a-9f79-329cb558be37 service nova] Creating event network-vif-deleted:dc6ce4e8-3940-405a-82fa-ee8b6d0fd6d3 for instance a3997288-5b3f-4013-bcad-f59ce5f32db3 on hv-cinder-80473 Nov 22 16:50:24.020594 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 311/613] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:23 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1271 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:24.022328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-9b96e718-4bad-47c0-9641-a19a87a48453 req-d95067f6-5035-4b4a-9f79-329cb558be37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044566 Nov 22 16:50:24.022921 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 303/614] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:24.253981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:24.255193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:24.264112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:24.264509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:24.265754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:24.266533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:24.306644 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:24.307360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:24.308067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lazy-loading 'fault' on Instance uuid a3997288-5b3f-4013-bcad-f59ce5f32db3 {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:50:24.356210 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '112824f29e5f44c283f56b34ea893d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46cf61d791e04bc483cab9a8f8745008', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:24.374256 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-935622cf-c62d-4b57-888c-cb292a479fad tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 200 len: 1312 microversion: 2.1 time: 0.124466 Nov 22 16:50:24.374920 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 312/615] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:24 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 1312 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:24.787449 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:24.788392 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:24.795286 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:24.795841 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:24.796729 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:24.797237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:24.973220 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:24.990887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:24.994478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:24.997815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-43bcfe14-a2bf-4ebe-b2a4-6902881a2bd8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1796 microversion: 2.20 time: 0.214656 Nov 22 16:50:24.998955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 304/616] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:50:24 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1796 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:50:25.031669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:25.032725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:25.041071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:25.041793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:25.042598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:25.043030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:25.277391 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:25.287165 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4d8cd5ef-d015-4b00-a90f-799a036865e4 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.257865 Nov 22 16:50:25.288295 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 313/617] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:25 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:25.395460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:25.396132 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] [instance: a3997288-5b3f-4013-bcad-f59ce5f32db3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:25.405238 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:25.405916 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:25.406974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:25.407997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:25.427678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] HTTP exception thrown: Instance a3997288-5b3f-4013-bcad-f59ce5f32db3 could not be found. Nov 22 16:50:25.428467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] Returning 404 to user: Instance a3997288-5b3f-4013-bcad-f59ce5f32db3 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:50:25.429367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-28efab02-919d-437d-b80c-5db32c769836 tempest-ServerRescueNegativeTestJSON-2080634635 tempest-ServerRescueNegativeTestJSON-2080634635-project] 10.222.0.61 "GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3" status: 404 len: 111 microversion: 2.1 time: 0.039764 Nov 22 16:50:25.430166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 305/618] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:25 2021] GET /compute/v2.1/servers/a3997288-5b3f-4013-bcad-f59ce5f32db3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 16:50:26.099547 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-5bbce240-b4c9-40b0-a70e-c30ab40f6450 req-e0f748e8-54df-4fb3-93e7-5cfbe9843ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6343df2b-304f-4991-9697-7bd7dd5a3b13", "tag": "1676410b-0aaa-4806-93b0-8558c63191e1"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:26.105824 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:26.105824 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:26.124848 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-5bbce240-b4c9-40b0-a70e-c30ab40f6450 req-e0f748e8-54df-4fb3-93e7-5cfbe9843ecc service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:26.125531 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-5bbce240-b4c9-40b0-a70e-c30ab40f6450 req-e0f748e8-54df-4fb3-93e7-5cfbe9843ecc service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:26.152334 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-5bbce240-b4c9-40b0-a70e-c30ab40f6450 req-e0f748e8-54df-4fb3-93e7-5cfbe9843ecc service nova] Creating event network-changed:1676410b-0aaa-4806-93b0-8558c63191e1 for instance 6343df2b-304f-4991-9697-7bd7dd5a3b13 on hv-cinder-80473 Nov 22 16:50:26.160136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-5bbce240-b4c9-40b0-a70e-c30ab40f6450 req-e0f748e8-54df-4fb3-93e7-5cfbe9843ecc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071923 Nov 22 16:50:26.161258 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 314/619] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:50:26.306799 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:26.307444 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:26.313770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:26.314329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:26.315163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:26.315941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:26.690312 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:26.698590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0869ef89-e721-425a-9536-739b4068e59c tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.395414 Nov 22 16:50:26.699242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 306/620] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:26 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:27.717440 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:27.719052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:27.725473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:27.725931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:27.726975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:27.727639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:27.964652 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:27.973239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e1fac472-0025-4b5e-93ca-02447bdba45e tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.260461 Nov 22 16:50:27.973951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 315/621] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:27 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:28.991569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:28.992137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:28.999583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:29.000057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:29.000859 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:29.001292 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:29.271073 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:29.278287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-86737661-45fe-4464-bc38-3769283392c2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.291448 Nov 22 16:50:29.278846 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 307/622] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:28 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:29.415861 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1476455063", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:29.474225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] validate_networks() for None {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:50:30.021089 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:50:30.021732 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:50:30.022750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:50:30.022750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:50:30.022999 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:50:30.033795 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:30.034381 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:30.035203 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:30.035798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:30.056737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Getting quotas for project 45d7ec58882c441bbb9a023109ed238e. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:50:30.062292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Getting quotas for user ed18739bf430437098455e1bb127a92a and project 45d7ec58882c441bbb9a023109ed238e. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:50:30.080557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:50:30.085375 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:50:30.132179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a2669c4c-ebdb-4c12-b836-af1adbf9b6d5 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719980 Nov 22 16:50:30.137669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 316/623] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:50:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:50:30.147608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a9b38c55-cb79-4c0d-ab43-3fa8e8619603 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:30.148637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a9b38c55-cb79-4c0d-ab43-3fa8e8619603 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:30.230521 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a9b38c55-cb79-4c0d-ab43-3fa8e8619603 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:30.242169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a9b38c55-cb79-4c0d-ab43-3fa8e8619603 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1215 microversion: 2.1 time: 0.098858 Nov 22 16:50:30.244014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 308/624] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:30 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1215 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:30.298986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:30.300528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:30.311325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:30.312157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:30.313581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:30.314321 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:30.495945 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:30.505800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5e95a75a-4034-4083-ac20-b5c3d1bafd94 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.212691 Nov 22 16:50:30.506717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 317/625] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:30 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:31.254228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c8f99ad0-f28b-4f4d-9788-058daf2cfe2c tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Action: 'create', calling method: .version_select at 0x7fc695a5d310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-533728571", "metadata": {"Type": "work"}}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:31.260783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:31.261426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:31.269113 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:31.269617 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:31.270428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:31.270877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:31.338707 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:31.350157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5134bb28-6be5-4d8e-b2d2-25cde1735f6b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1219 microversion: 2.1 time: 0.092664 Nov 22 16:50:31.350908 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 318/626] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:31 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:31.523369 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:31.524092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:31.530447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:31.530892 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:31.531682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:31.532139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:31.610448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c8f99ad0-f28b-4f4d-9788-058daf2cfe2c tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.475901 Nov 22 16:50:31.617315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 309/627] 10.222.0.61 () {60 vars in 1155 bytes} [Mon Nov 22 16:50:31 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 478 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 16:50:31.624043 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9a3bc5a1-c35d-48d1-8dff-34f1b898c69a tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Calling method '.version_select at 0x7fc695abe9d0>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:31.686402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9a3bc5a1-c35d-48d1-8dff-34f1b898c69a tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e" status: 200 len: 352 microversion: 2.1 time: 0.067580 Nov 22 16:50:31.687260 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 310/628] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:50:31 2021] GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:31.697666 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:31.705313 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c3fb6e86-9b87-4e83-bc98-a5d7621562ed tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.185565 Nov 22 16:50:31.705968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 319/629] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:31 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:32.372420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:32.372974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:32.379228 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:32.379701 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:32.380549 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:32.381195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:32.449396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:32.458021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ac9a7a12-da59-4e33-b96a-08c485464047 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1275 microversion: 2.1 time: 0.089723 Nov 22 16:50:32.458600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 311/630] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:32 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:32.698127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-673495ef-49ce-46ad-b92b-18ed127dbc82 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Calling method '.version_select at 0x7fc6955599d0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:32.722869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:32.723572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:32.735984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:32.735984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:32.736169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:32.736570 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:32.761094 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-673495ef-49ce-46ad-b92b-18ed127dbc82 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e" status: 200 len: 353 microversion: 2.1 time: 0.066475 Nov 22 16:50:32.761861 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 320/631] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:50:32 2021] GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:32.772986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aaf8bb3c-0acd-4d48-a608-df934a6d4f64 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Calling method '.version_select at 0x7fc69530a160>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:32.865360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aaf8bb3c-0acd-4d48-a608-df934a6d4f64 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e" status: 200 len: 353 microversion: 2.1 time: 0.096393 Nov 22 16:50:32.865935 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 321/632] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:50:32 2021] GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e => generated 353 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:50:32.884124 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aee56126-78d0-45dd-8d66-d334faf8d432 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Calling method '.version_select at 0x7fc6952bf8b0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:32.927942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:32.938178 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8c1406bb-7cfe-4b8e-a0f6-4a671aaa0e87 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.219335 Nov 22 16:50:32.953059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 312/633] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:32 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:32.962444 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aee56126-78d0-45dd-8d66-d334faf8d432 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e" status: 202 len: 0 microversion: 2.1 time: 0.084420 Nov 22 16:50:32.963602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 322/634] 10.222.0.61 () {58 vars in 1247 bytes} [Mon Nov 22 16:50:32 2021] DELETE /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:50:32.971868 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bf7b478c-ac8d-46a5-996f-bb37ffea823f tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Calling method '.version_select at 0x7fc695c22670>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:33.033242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bf7b478c-ac8d-46a5-996f-bb37ffea823f tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e" status: 200 len: 352 microversion: 2.1 time: 0.064733 Nov 22 16:50:33.034569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 313/635] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:50:32 2021] GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e => generated 352 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:33.477503 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:33.477503 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:33.488309 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:33.490925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:33.492481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:33.492481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:33.693646 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:33.703476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0934b113-d954-4604-afdc-8e3dd9075a5e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.230454 Nov 22 16:50:33.704170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 323/636] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:33 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:33.963470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:33.966956 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:33.979630 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:33.980654 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:33.982210 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:33.983176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:34.053832 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-193d4718-c486-4315-aa8b-e88ba9cc48c9 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Calling method '.version_select at 0x7fc6952bff70>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:34.120564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-193d4718-c486-4315-aa8b-e88ba9cc48c9 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] HTTP exception thrown: Volume 6ef07b3e-0953-4061-bfdb-fcad0d0a037e could not be found. Nov 22 16:50:34.123377 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-193d4718-c486-4315-aa8b-e88ba9cc48c9 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] Returning 404 to user: Volume 6ef07b3e-0953-4061-bfdb-fcad0d0a037e could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:50:34.127146 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-193d4718-c486-4315-aa8b-e88ba9cc48c9 tempest-VolumesGetTestJSON-335841947 tempest-VolumesGetTestJSON-335841947-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e" status: 404 len: 109 microversion: 2.1 time: 0.083237 Nov 22 16:50:34.128765 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 324/637] 10.222.0.61 () {58 vars in 1244 bytes} [Mon Nov 22 16:50:34 2021] GET /compute/v2.1/os-volumes/6ef07b3e-0953-4061-bfdb-fcad0d0a037e => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:50:34.138357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-2480d19c-8cfa-4a7c-b0a0-041677c4f951 req-0b35a6ae-0519-4b92-80fb-3bce400493c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6343df2b-304f-4991-9697-7bd7dd5a3b13", "name": "network-vif-plugged", "status": "completed", "tag": "1676410b-0aaa-4806-93b0-8558c63191e1"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:34.141643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:34.141643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:34.183420 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2480d19c-8cfa-4a7c-b0a0-041677c4f951 req-0b35a6ae-0519-4b92-80fb-3bce400493c6 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:34.192976 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2480d19c-8cfa-4a7c-b0a0-041677c4f951 req-0b35a6ae-0519-4b92-80fb-3bce400493c6 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:34.226915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-2480d19c-8cfa-4a7c-b0a0-041677c4f951 req-0b35a6ae-0519-4b92-80fb-3bce400493c6 service nova] Creating event network-vif-plugged:1676410b-0aaa-4806-93b0-8558c63191e1 for instance 6343df2b-304f-4991-9697-7bd7dd5a3b13 on hv-cinder-80473 Nov 22 16:50:34.247208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-2480d19c-8cfa-4a7c-b0a0-041677c4f951 req-0b35a6ae-0519-4b92-80fb-3bce400493c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114240 Nov 22 16:50:34.249348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 325/638] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:34.302210 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:34.315786 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6928bc23-4089-4220-a991-470c7f9b9269 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.360183 Nov 22 16:50:34.342598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 314/639] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:33 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:34.497811 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-78269787-09bc-47c0-82fa-06a6d34a857b req-bd54658c-a960-4130-a968-9c0eb4478d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51d92756-cf95-4524-89ca-867f1b44181d", "tag": "cbf70b21-7b95-4c9b-a660-8eddcf6ac227"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:34.500754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:34.500754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:34.510661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-78269787-09bc-47c0-82fa-06a6d34a857b req-bd54658c-a960-4130-a968-9c0eb4478d9d service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:34.511249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-78269787-09bc-47c0-82fa-06a6d34a857b req-bd54658c-a960-4130-a968-9c0eb4478d9d service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:34.529354 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-78269787-09bc-47c0-82fa-06a6d34a857b req-bd54658c-a960-4130-a968-9c0eb4478d9d service nova] Creating event network-changed:cbf70b21-7b95-4c9b-a660-8eddcf6ac227 for instance 51d92756-cf95-4524-89ca-867f1b44181d on hv-cinder-80473 Nov 22 16:50:34.535509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-78269787-09bc-47c0-82fa-06a6d34a857b req-bd54658c-a960-4130-a968-9c0eb4478d9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042511 Nov 22 16:50:34.537419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 326/640] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:34.731158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:34.732006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:34.740867 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:34.741418 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:34.743021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:34.743737 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:34.957076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:34.973165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-466eb87f-a6f7-4950-a4ca-dfd009b42ccb tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.245914 Nov 22 16:50:34.974313 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 315/641] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:34 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:35.340999 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:35.341906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:35.354052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:35.354544 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:35.355314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:35.355774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:35.616028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:35.625293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cec9a79b-bd75-4a62-b358-93d9c49fb7f8 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1319 microversion: 2.1 time: 0.292226 Nov 22 16:50:35.625882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 327/642] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:35 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:35.998584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:35.999979 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:36.009184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:36.009663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:36.010764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:36.011763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:36.259619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:36.274568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ea9d7fc8-fc3b-4a51-82d0-1c1ec2b8f1d8 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.280788 Nov 22 16:50:36.275213 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 316/643] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:35 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:36.649593 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:36.650566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:36.669826 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:36.670597 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:36.672284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:36.672993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:36.883553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:36.898062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cb0bba26-f00e-445f-a9f2-92b1c364e2eb tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1508 microversion: 2.1 time: 0.256267 Nov 22 16:50:36.898948 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 328/644] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:36 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:36.918822 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84cd9e4c-0af8-4042-94ee-3d2a2bab9793", "device": "/dev/sdb"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:36.921046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:36.929035 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:36.929505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:36.930341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:36.930810 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:37.243896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4c0916ec-9e65-4fa3-817c-d0dd9cd8542f tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "POST /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330279 Nov 22 16:50:37.244783 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 317/645] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:50:36 2021] POST /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:37.295131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:37.295747 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:37.305331 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:37.306524 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:37.308166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:37.309610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:37.501930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:37.511209 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ee141c83-46d6-4ca3-8a53-dcf1e456701f tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.222226 Nov 22 16:50:37.511887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 329/646] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:37 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:38.529771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:38.530448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:38.537602 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:38.538062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:38.538859 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:38.539295 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:38.798095 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:38.812894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2534a9f5-be6c-478d-85a1-1b12c637f853 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.287434 Nov 22 16:50:38.814547 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 318/647] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:38 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:39.842703 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:39.851331 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:39.862015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:39.863628 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:39.865588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:39.866694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:40.107558 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:40.125472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-98602b53-7469-4c54-b138-c028a79b31d2 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.289502 Nov 22 16:50:40.127459 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 330/648] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:39 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:41.148250 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:41.149027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:41.155950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:41.156572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:41.157546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:41.158054 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:41.340393 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:41.351033 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8cfd9c36-cf0d-422e-90c5-5ae4e27b8b3b tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.208772 Nov 22 16:50:41.351621 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 319/649] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:41 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:42.000256 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-d5716063-be0d-4c23-9ed0-32fa62ddef43 req-511a2d89-a9b6-493d-89bd-17c62073d305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d92756-cf95-4524-89ca-867f1b44181d", "name": "network-vif-plugged", "status": "completed", "tag": "cbf70b21-7b95-4c9b-a660-8eddcf6ac227"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:42.001787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:42.001787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:50:42.011036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d5716063-be0d-4c23-9ed0-32fa62ddef43 req-511a2d89-a9b6-493d-89bd-17c62073d305 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:42.011470 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d5716063-be0d-4c23-9ed0-32fa62ddef43 req-511a2d89-a9b6-493d-89bd-17c62073d305 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:42.023931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-d5716063-be0d-4c23-9ed0-32fa62ddef43 req-511a2d89-a9b6-493d-89bd-17c62073d305 service nova] Creating event network-vif-plugged:cbf70b21-7b95-4c9b-a660-8eddcf6ac227 for instance 51d92756-cf95-4524-89ca-867f1b44181d on hv-cinder-80473 Nov 22 16:50:42.029329 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-d5716063-be0d-4c23-9ed0-32fa62ddef43 req-511a2d89-a9b6-493d-89bd-17c62073d305 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033176 Nov 22 16:50:42.030399 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 331/650] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:42.369504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:42.370187 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:42.377592 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:42.378163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:42.378983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:42.379423 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:42.572025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:42.581861 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-04fb2600-19e3-45ea-848c-4d565dd0e778 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1315 microversion: 2.1 time: 0.215746 Nov 22 16:50:42.582456 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 320/651] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:42 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:43.609301 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:43.611069 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:43.623989 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:43.624452 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:43.625254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:43.625697 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:43.801320 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:43.809364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-66bfc3b1-942b-4259-b1ba-9919c1f3125e tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1465 microversion: 2.1 time: 0.210311 Nov 22 16:50:43.809938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 332/652] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:43 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1465 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:43.852144 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:43.853242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:43.859219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:43.859585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:43.860381 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:43.860818 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:43.889006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:50:43.977934 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-386db7ca-4351-4882-be49-92d930481aa4 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "DELETE /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 204 len: 0 microversion: 2.1 time: 0.129002 Nov 22 16:50:43.979301 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 321/653] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:50:43 2021] DELETE /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:50:43.988177 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:43.988936 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:43.995383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:43.995860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:43.996643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:43.997077 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:44.155788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:44.168993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-da6fde79-2e7a-442c-afe2-c5b8414cb1d1 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1471 microversion: 2.1 time: 0.185286 Nov 22 16:50:44.170573 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 333/654] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:43 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:45.188602 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:45.189965 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:45.197385 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:45.197895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:45.199015 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:45.199471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:45.358993 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:45.366517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-277d01ca-903a-440b-931e-78ebfb93c179 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1471 microversion: 2.1 time: 0.181803 Nov 22 16:50:45.367090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 322/655] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:45 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:46.392419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:46.393201 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:46.402698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:46.403127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:46.403817 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:46.404288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:46.575339 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:46.589934 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-09326a74-6cca-4810-808f-c29ae92dd225 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1471 microversion: 2.1 time: 0.200749 Nov 22 16:50:46.590845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 334/656] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:46 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:47.610296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:47.610933 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:47.617520 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:47.618262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:47.619940 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:47.620382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:47.762711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:47.771370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-144afed5-58dc-47c9-afe6-b6f54350ce26 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1471 microversion: 2.1 time: 0.164671 Nov 22 16:50:47.771994 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 323/657] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:47 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:48.789382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:48.790095 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:48.796689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:48.797173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:48.797918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:48.798431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:48.987878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:48.998027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6bd93e1f-67ce-42ea-bcc1-d874c5b716ad tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1471 microversion: 2.1 time: 0.212262 Nov 22 16:50:48.999015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 335/658] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:48 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:49.319935 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-49424098-76c3-49cf-8b81-02c9ccc75a6c req-00f7a777-a6aa-4a4f-b898-0c673d508c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51d92756-cf95-4524-89ca-867f1b44181d", "name": "network-vif-deleted", "tag": "cbf70b21-7b95-4c9b-a660-8eddcf6ac227"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:50:49.323925 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:50:49.323925 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:50:49.345063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-49424098-76c3-49cf-8b81-02c9ccc75a6c req-00f7a777-a6aa-4a4f-b898-0c673d508c63 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:49.352209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-49424098-76c3-49cf-8b81-02c9ccc75a6c req-00f7a777-a6aa-4a4f-b898-0c673d508c63 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:49.391484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-49424098-76c3-49cf-8b81-02c9ccc75a6c req-00f7a777-a6aa-4a4f-b898-0c673d508c63 service nova] Creating event network-vif-deleted:cbf70b21-7b95-4c9b-a660-8eddcf6ac227 for instance 51d92756-cf95-4524-89ca-867f1b44181d on hv-cinder-80473 Nov 22 16:50:49.404474 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-49424098-76c3-49cf-8b81-02c9ccc75a6c req-00f7a777-a6aa-4a4f-b898-0c673d508c63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089976 Nov 22 16:50:49.408709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 324/659] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:50:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:50:50.017042 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:50.017746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:50.030941 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:50.037787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:50.037787 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:50.038084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:50.079059 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:50.079529 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:50.080027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lazy-loading 'fault' on Instance uuid 51d92756-cf95-4524-89ca-867f1b44181d {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:50:50.130632 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:50.144545 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2733b50b-ef8b-435f-b82c-c8c220e47a4c tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1305 microversion: 2.1 time: 0.131674 Nov 22 16:50:50.145137 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 336/660] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:50 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:50:51.163334 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:51.164417 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:51.170799 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:51.171240 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:51.172052 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:51.172506 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:51.206729 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:51.207057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:51.207504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lazy-loading 'fault' on Instance uuid 51d92756-cf95-4524-89ca-867f1b44181d {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:50:51.250546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed18739bf430437098455e1bb127a92a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45d7ec58882c441bbb9a023109ed238e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:50:51.259129 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-fa082d03-af38-4bcc-a51d-bb87b0c63d48 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 200 len: 1305 microversion: 2.1 time: 0.100503 Nov 22 16:50:51.259698 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 325/661] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:51 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 1305 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:50:52.276953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:52.278040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] [instance: 51d92756-cf95-4524-89ca-867f1b44181d] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:52.284072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:52.284517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:52.285305 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:52.285736 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:52.301629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] HTTP exception thrown: Instance 51d92756-cf95-4524-89ca-867f1b44181d could not be found. Nov 22 16:50:52.302229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] Returning 404 to user: Instance 51d92756-cf95-4524-89ca-867f1b44181d could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:50:52.303053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5d3296ed-c46a-441b-bb7d-510bf7559484 tempest-VolumesNegativeTest-1266815108 tempest-VolumesNegativeTest-1266815108-project] 10.222.0.61 "GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d" status: 404 len: 111 microversion: 2.1 time: 0.030505 Nov 22 16:50:52.303673 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 337/662] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:50:52 2021] GET /compute/v2.1/servers/51d92756-cf95-4524-89ca-867f1b44181d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:50:59.073407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:50:59.073939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:50:59.081129 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:59.081929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:59.082738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:50:59.083171 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:50:59.180345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lazy-loading 'services' on Instance uuid 6343df2b-304f-4991-9697-7bd7dd5a3b13 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:50:59.284978 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f29cd819-14cd-4bd4-a3a5-2e94d2454a6b tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13/os-volume_attachments/84cd9e4c-0af8-4042-94ee-3d2a2bab9793" status: 202 len: 0 microversion: 2.1 time: 0.216333 Nov 22 16:50:59.285613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 326/663] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:50:59 2021] DELETE /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13/os-volume_attachments/84cd9e4c-0af8-4042-94ee-3d2a2bab9793 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:00.440678 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:00.441606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:00.448373 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:00.449393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:00.450407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:00.451114 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:00.481981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:51:00.588019 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8329a29e-6af5-4247-b376-4bf06d99e0dd tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 204 len: 0 microversion: 2.1 time: 0.150885 Nov 22 16:51:00.588982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 338/664] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:51:00 2021] DELETE /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:51:00.605728 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:00.606940 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:00.617345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:00.618583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:00.619911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:00.620561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:00.782548 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:00.791467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8b4e56d6-2e02-4ec5-b273-103a61618d85 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1514 microversion: 2.1 time: 0.194729 Nov 22 16:51:00.792187 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 327/665] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:00 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:01.810770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:01.811796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:01.821467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:01.821978 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:01.822877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:01.823589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:02.027656 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:02.039577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-604e88c8-cfa6-48ba-ad9d-d5cee05b0595 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1514 microversion: 2.1 time: 0.232501 Nov 22 16:51:02.040541 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 339/666] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:01 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:03.060715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:03.061503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:03.082911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:03.083370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:03.084214 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:03.084650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:03.267009 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a64bf88a7e446c0aa8e8aeb1bdadac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1322235371824c2aba7f0fdaea4775f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:03.277062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4178a042-42ca-4aa5-a0ea-3bac57cbcfd2 tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 200 len: 1514 microversion: 2.1 time: 0.220109 Nov 22 16:51:03.277934 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 328/667] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:03 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:03.672611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-944ee688-4747-487d-b85e-2b532f87bf35 req-132a3be1-fc04-45ed-8f84-9f6b55961f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6343df2b-304f-4991-9697-7bd7dd5a3b13", "name": "network-vif-deleted", "tag": "1676410b-0aaa-4806-93b0-8558c63191e1"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:03.677350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:03.677350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:51:03.700682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-944ee688-4747-487d-b85e-2b532f87bf35 req-132a3be1-fc04-45ed-8f84-9f6b55961f0e service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:03.701456 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-944ee688-4747-487d-b85e-2b532f87bf35 req-132a3be1-fc04-45ed-8f84-9f6b55961f0e service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:03.728123 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-944ee688-4747-487d-b85e-2b532f87bf35 req-132a3be1-fc04-45ed-8f84-9f6b55961f0e service nova] Creating event network-vif-deleted:1676410b-0aaa-4806-93b0-8558c63191e1 for instance 6343df2b-304f-4991-9697-7bd7dd5a3b13 on hv-cinder-80473 Nov 22 16:51:03.735739 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-944ee688-4747-487d-b85e-2b532f87bf35 req-132a3be1-fc04-45ed-8f84-9f6b55961f0e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069958 Nov 22 16:51:03.737464 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 340/668] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:04.296564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:04.297864 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] [instance: 6343df2b-304f-4991-9697-7bd7dd5a3b13] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:04.320338 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:04.321813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:04.324134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:04.324853 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:04.345010 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] HTTP exception thrown: Instance 6343df2b-304f-4991-9697-7bd7dd5a3b13 could not be found. Nov 22 16:51:04.345917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] Returning 404 to user: Instance 6343df2b-304f-4991-9697-7bd7dd5a3b13 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:51:04.346934 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ed49b065-6f4a-4f20-b363-c07ea9b543ac tempest-VolumesSnapshotTestJSON-1063033036 tempest-VolumesSnapshotTestJSON-1063033036-project] 10.222.0.61 "GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13" status: 404 len: 111 microversion: 2.1 time: 0.054572 Nov 22 16:51:04.347492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 329/669] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:04 2021] GET /compute/v2.1/servers/6343df2b-304f-4991-9697-7bd7dd5a3b13 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:51:08.471704 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:08.472973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:08.487077 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:08.487522 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:08.488361 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:08.488994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:08.550403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-13be72d6-8d4e-456a-9939-e108730896f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments/eeefe471-da1d-4e2e-be3e-02299a944033" status: 200 len: 194 microversion: 2.20 time: 0.080537 Nov 22 16:51:08.590160 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 341/670] 10.222.0.61 () {60 vars in 1453 bytes} [Mon Nov 22 16:51:08 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments/eeefe471-da1d-4e2e-be3e-02299a944033 => generated 194 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:51:08.664368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:08.665683 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:08.682974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:08.685371 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:08.692266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:08.693564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:08.888642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lazy-loading 'services' on Instance uuid 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:51:09.013410 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-01c42979-b36a-44cf-945c-621221aa82d1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments/eeefe471-da1d-4e2e-be3e-02299a944033" status: 202 len: 0 microversion: 2.20 time: 0.353190 Nov 22 16:51:09.022423 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 330/671] 10.222.0.61 () {60 vars in 1456 bytes} [Mon Nov 22 16:51:08 2021] DELETE /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments/eeefe471-da1d-4e2e-be3e-02299a944033 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:51:09.029283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:09.030528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:09.045662 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:09.046563 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:09.046963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:09.047403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:09.116843 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-547cf3c4-f794-4a83-bde3-189fe53559ba tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092159 Nov 22 16:51:09.128030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 342/672] 10.222.0.61 () {60 vars in 1342 bytes} [Mon Nov 22 16:51:09 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:51:10.146952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:10.148182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:10.170942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:10.171390 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:10.172304 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:10.172917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:10.207773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b375573e-e6fb-4a1e-a6f3-b723ed11a549 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065620 Nov 22 16:51:10.213941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 331/673] 10.222.0.61 () {60 vars in 1342 bytes} [Mon Nov 22 16:51:10 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:51:11.228615 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:11.230387 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:11.238886 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:11.239581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:11.240602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:11.241212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:11.297218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-73ebc3ab-1891-477e-ae5d-3c52d793e95f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.073045 Nov 22 16:51:11.299047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 343/674] 10.222.0.61 () {60 vars in 1342 bytes} [Mon Nov 22 16:51:11 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:11.382899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:11.386037 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:11.394370 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:11.395075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:11.396099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:11.396697 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:11.428457 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:51:11.542128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bc740053-68eb-4caa-aec4-6c5f76819bc0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 204 len: 0 microversion: 2.20 time: 0.163122 Nov 22 16:51:11.542789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 332/675] 10.222.0.61 () {60 vars in 1279 bytes} [Mon Nov 22 16:51:11 2021] DELETE /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 16:51:11.551581 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:11.552537 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:11.559595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:11.560336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:11.561224 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:11.561780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:11.717357 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:11.726791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:11.728708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:11.730294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ce2d0912-b9ae-46e4-8a42-70c50120010d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.183014 Nov 22 16:51:11.730933 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 333/676] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:11 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:11.737214 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a3bc1da4-4cd8-47e1-aebb-4217ab97819f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Action: 'create', calling method: .version_select at 0x7fc6952c9820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1382229380"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:11.747211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-a3bc1da4-4cd8-47e1-aebb-4217ab97819f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for project dd6bb6026ac74775904d68f7483c79c8. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:11.751308 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-a3bc1da4-4cd8-47e1-aebb-4217ab97819f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for user 431675338a834fcda7bc05e51ac001a1 and project dd6bb6026ac74775904d68f7483c79c8. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:11.937386 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-a3bc1da4-4cd8-47e1-aebb-4217ab97819f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for project dd6bb6026ac74775904d68f7483c79c8. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:11.942527 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-a3bc1da4-4cd8-47e1-aebb-4217ab97819f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for user 431675338a834fcda7bc05e51ac001a1 and project dd6bb6026ac74775904d68f7483c79c8. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:11.966361 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a3bc1da4-4cd8-47e1-aebb-4217ab97819f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.455366 Nov 22 16:51:11.968063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 344/677] 10.222.0.61 () {60 vars in 1157 bytes} [Mon Nov 22 16:51:11 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:12.750450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:12.751061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:12.759352 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:12.760088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:12.761100 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:12.761534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:12.979182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:12.997343 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:13.000071 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:13.002145 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0544d076-5270-4d84-a469-c92a189b7b91 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.255651 Nov 22 16:51:13.004142 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 334/678] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:12 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:14.026812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:14.028905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:14.039380 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:14.040238 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:14.041681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:14.042581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:14.205930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:14.218600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:14.221112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:14.223139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-317c07c8-4a2f-4ec6-8098-6f314ab9c38a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 200 len: 1724 microversion: 2.20 time: 0.204228 Nov 22 16:51:14.223724 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 345/679] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:14 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:51:14.540660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-4f820908-6b29-4965-b980-e4ef91f9bf36 req-dda4052b-fc34-4bbe-ab3c-b55e880308cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cc37184-5ac8-4a2a-98b9-7eab6cf00413", "name": "network-vif-deleted", "tag": "d268de10-396c-4f46-8ccd-83e594f2207e"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:14.543747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:14.543747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:51:14.562290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-4f820908-6b29-4965-b980-e4ef91f9bf36 req-dda4052b-fc34-4bbe-ab3c-b55e880308cf service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:14.563040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-4f820908-6b29-4965-b980-e4ef91f9bf36 req-dda4052b-fc34-4bbe-ab3c-b55e880308cf service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:14.577464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-4f820908-6b29-4965-b980-e4ef91f9bf36 req-dda4052b-fc34-4bbe-ab3c-b55e880308cf service nova] Creating event network-vif-deleted:d268de10-396c-4f46-8ccd-83e594f2207e for instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 on hv-cinder-80473 Nov 22 16:51:14.585022 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-4f820908-6b29-4965-b980-e4ef91f9bf36 req-dda4052b-fc34-4bbe-ab3c-b55e880308cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048609 Nov 22 16:51:14.586070 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 335/680] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:15.243439 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:15.244205 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:15.256985 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:15.259881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:15.272119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:15.278160 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:15.300038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] HTTP exception thrown: Instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 could not be found. Nov 22 16:51:15.300898 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Returning 404 to user: Instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:51:15.301931 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a8c46f3f-e9ea-4d8d-9437-4a6f6d4b6238 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 404 len: 111 microversion: 2.20 time: 0.063182 Nov 22 16:51:15.303068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 346/681] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:15 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 22 16:51:15.313211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-fe4df409-4297-44e2-82cd-8a0aaf02261b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '.version_select at 0x7fc695a73f70>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:15.378369 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-fe4df409-4297-44e2-82cd-8a0aaf02261b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526480785" status: 204 len: 0 microversion: 2.20 time: 0.070145 Nov 22 16:51:15.380724 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 336/682] 10.222.0.61 () {60 vars in 1261 bytes} [Mon Nov 22 16:51:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526480785 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 16:51:16.492011 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7a1b72e2-26c0-49b9-a96f-e892aa68ab04 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'create', calling method: .version_select at 0x7fc69525d310>, body: {"keypair": {"name": "tempest-keypair-403001559"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:16.522550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-7a1b72e2-26c0-49b9-a96f-e892aa68ab04 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:16.527774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-7a1b72e2-26c0-49b9-a96f-e892aa68ab04 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for user d7a9d997c1644148ba43d758c3e02ef6 and project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:16.809904 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-7a1b72e2-26c0-49b9-a96f-e892aa68ab04 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:16.819506 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-7a1b72e2-26c0-49b9-a96f-e892aa68ab04 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for user d7a9d997c1644148ba43d758c3e02ef6 and project 7531002e08024f178aeaba0f112be50a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:16.853407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7a1b72e2-26c0-49b9-a96f-e892aa68ab04 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.370089 Nov 22 16:51:16.859173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 347/683] 10.222.0.61 () {62 vars in 1198 bytes} [Mon Nov 22 16:51:16 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 374 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 16:51:18.357184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1905120788", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c9a20d6-fe56-4f54-a96e-edd086f5cc72"}], "security_groups": [{"name": "tempest-securitygroup--552022892"}], "key_name": "tempest-keypair-403001559", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:18.605871 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] validate_networks() for [('2c9a20d6-fe56-4f54-a96e-edd086f5cc72', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:51:19.003260 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:51:19.003659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:51:19.004176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:51:19.004589 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:51:19.005001 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:51:19.013768 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:19.014239 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:19.015039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:19.015480 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:19.034384 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for project 7531002e08024f178aeaba0f112be50a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:19.038680 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Getting quotas for user d7a9d997c1644148ba43d758c3e02ef6 and project 7531002e08024f178aeaba0f112be50a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:19.050553 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:51:19.053022 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:51:19.103276 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bc792a40-6462-4efa-a232-416a4b7ffbd1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.750410 Nov 22 16:51:19.104531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 337/684] 10.222.0.61 () {62 vars in 1187 bytes} [Mon Nov 22 16:51:18 2021] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 16:51:19.115981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ae3a5375-2ae0-45c9-883e-3b93d43ead27 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:19.122979 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ae3a5375-2ae0-45c9-883e-3b93d43ead27 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:19.343889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ae3a5375-2ae0-45c9-883e-3b93d43ead27 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:19.351844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ae3a5375-2ae0-45c9-883e-3b93d43ead27 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:19.353532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ae3a5375-2ae0-45c9-883e-3b93d43ead27 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:19.354657 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ae3a5375-2ae0-45c9-883e-3b93d43ead27 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1281 microversion: 2.20 time: 0.243725 Nov 22 16:51:19.355221 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 348/685] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:19 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1281 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:20.384191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:20.387564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:20.396371 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:20.397148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:20.399195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:20.399195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:20.505701 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:20.514681 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:20.516786 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:20.518905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8d91f380-0696-4cdd-8f2a-5ab8547f02d2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1339 microversion: 2.20 time: 0.143225 Nov 22 16:51:20.519652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 338/686] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:20 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1339 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:21.539179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:21.539927 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:21.546458 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:21.547029 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:21.547924 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:21.548468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:21.787187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:21.797385 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:21.799806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:21.801463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-15218638-3976-443a-a7c6-89b8a77cbec9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.266635 Nov 22 16:51:21.802120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 349/687] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:21 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:22.035691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-dd445372-e4b6-4985-91e1-6916712d077d req-cd564d57-5423-4de0-acbe-a8964ef69baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:22.037493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:22.037493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:51:22.046870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-dd445372-e4b6-4985-91e1-6916712d077d req-cd564d57-5423-4de0-acbe-a8964ef69baf service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:22.047759 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-dd445372-e4b6-4985-91e1-6916712d077d req-cd564d57-5423-4de0-acbe-a8964ef69baf service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:22.062400 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-dd445372-e4b6-4985-91e1-6916712d077d req-cd564d57-5423-4de0-acbe-a8964ef69baf service nova] Creating event network-changed:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:51:22.069300 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-dd445372-e4b6-4985-91e1-6916712d077d req-cd564d57-5423-4de0-acbe-a8964ef69baf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037343 Nov 22 16:51:22.070039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 339/688] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:22.829448 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:22.830072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:22.836897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:22.837546 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:22.838346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:22.838786 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:22.992812 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:23.001316 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:23.002852 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:23.004001 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-04548f5d-142a-4935-9268-84937c18811c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.178199 Nov 22 16:51:23.005041 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 350/689] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:22 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:24.024535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:24.025379 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:24.031298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:24.031761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:24.032630 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:24.033246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:24.182131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:24.194461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:24.196481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:24.198472 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e1fc1ab9-3687-4120-bc39-0f376f8d8aea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.178254 Nov 22 16:51:24.199454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 340/690] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:24 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:25.217889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:25.218622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:25.225030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:25.225472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:25.226240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:25.226678 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:25.361696 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:25.369601 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:25.371079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:25.372189 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4232bb96-bff6-41c3-ba18-a9c775668bfc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.158302 Nov 22 16:51:25.372745 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 351/691] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:25 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:26.392562 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:26.393366 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:26.399988 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:26.400439 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:26.401232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:26.401663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:26.556306 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:26.574677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:26.577492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:26.579903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f4f53d48-b2d1-423d-97b3-af257161d093 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.190874 Nov 22 16:51:26.580828 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 341/692] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:26 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:27.603401 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:27.604388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:27.614698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:27.615405 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:27.616396 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:27.616936 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:27.819542 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:27.832354 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:27.834820 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:27.836842 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5551c065-6422-41dc-bd6d-fae02cb0490b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.240395 Nov 22 16:51:27.837566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 352/693] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:27 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:51:28.418457 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-e7b0ba62-5808-44f4-bdd4-ed42dd32147d req-730aae12-397a-418e-918a-94472b75a9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "name": "network-vif-plugged", "status": "completed", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:28.420622 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:28.420622 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:51:28.428998 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e7b0ba62-5808-44f4-bdd4-ed42dd32147d req-730aae12-397a-418e-918a-94472b75a9d5 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:28.429461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-e7b0ba62-5808-44f4-bdd4-ed42dd32147d req-730aae12-397a-418e-918a-94472b75a9d5 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:28.441936 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-e7b0ba62-5808-44f4-bdd4-ed42dd32147d req-730aae12-397a-418e-918a-94472b75a9d5 service nova] Creating event network-vif-plugged:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:51:28.446788 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-e7b0ba62-5808-44f4-bdd4-ed42dd32147d req-730aae12-397a-418e-918a-94472b75a9d5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 Nov 22 16:51:28.447396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 342/694] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:28.867303 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:28.867953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:28.874647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:28.875412 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:28.876739 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:28.877304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:29.062275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:29.072438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:29.074055 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:29.075381 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-de1d59bb-e9bf-4161-bc41-4f2124c0332b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1406 microversion: 2.20 time: 0.214361 Nov 22 16:51:29.090438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 353/695] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:28 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:30.096471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:30.097374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:30.103592 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:30.104105 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:30.104905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:30.105386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:30.266002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:30.279232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:30.280784 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:30.281971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8eea6272-6349-418c-8067-32a910eb2b10 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1598 microversion: 2.20 time: 0.190897 Nov 22 16:51:30.296247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 343/696] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:51:30 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1598 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:51:30.301775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:30.302331 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:30.309776 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:30.310538 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:30.311421 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:30.312030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:30.456139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a800bb15-65d0-4c1a-855c-e0502a2207b6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.158083 Nov 22 16:51:30.457176 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 354/697] 10.222.0.61 () {60 vars in 1315 bytes} [Mon Nov 22 16:51:30 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:51:31.873656 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:31.875504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:31.890651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:31.891401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:31.893698 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:31.901139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-a2fa5228-53de-423d-8b0d-43efeb5f16f2 req-08d5f686-c879-4336-b223-713d762701d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:31.903109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:31.903109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:51:31.907141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:31.920639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-a2fa5228-53de-423d-8b0d-43efeb5f16f2 req-08d5f686-c879-4336-b223-713d762701d6 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:31.926229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-a2fa5228-53de-423d-8b0d-43efeb5f16f2 req-08d5f686-c879-4336-b223-713d762701d6 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:31.956304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-a2fa5228-53de-423d-8b0d-43efeb5f16f2 req-08d5f686-c879-4336-b223-713d762701d6 service nova] Creating event network-changed:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:51:31.972200 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-a2fa5228-53de-423d-8b0d-43efeb5f16f2 req-08d5f686-c879-4336-b223-713d762701d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074705 Nov 22 16:51:31.974604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 355/698] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:51:32.060269 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-10a6dfe1-a3f6-47fa-a31a-ad21ac3abaed tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 0.190192 Nov 22 16:51:32.071156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 344/699] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:31 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:33.075593 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:33.077449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:33.084908 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:33.085619 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:33.086601 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:33.089642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:33.203152 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c0e9879b-3c93-433c-bb45-529edef876aa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 0.131474 Nov 22 16:51:33.206388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 356/700] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:33 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:34.217536 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:34.218766 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:34.227230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:34.227760 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:34.228650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:34.229296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:34.321801 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-664fb5d1-51be-471f-98a6-faf572e97bd3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 0.107943 Nov 22 16:51:34.328413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 345/701] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:34 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:35.344630 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:35.347976 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:35.348137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-95911253", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1382229380", "security_groups": [{"name": "tempest-secgroup-smoke-1121951638"}], "block_device_mapping_v2": [{"uuid": "b2696efe-7158-4516-aa09-9102f121d0ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b1c2e1e-d8e0-430c-9638-c1f4446f26b2"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:35.357234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:35.357962 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:35.358968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:35.359694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:35.552049 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] validate_networks() for [('0b1c2e1e-d8e0-430c-9638-c1f4446f26b2', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:51:36.649314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:51:36.649941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:51:36.650196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:51:36.650785 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:51:36.651201 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:51:36.664351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:36.664923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:36.665824 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:36.666555 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:36.685917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for project dd6bb6026ac74775904d68f7483c79c8. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:36.694338 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for user 431675338a834fcda7bc05e51ac001a1 and project dd6bb6026ac74775904d68f7483c79c8. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:36.775536 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:51:36.779692 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2696efe-7158-4516-aa09-9102f121d0ad',volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:51:36.953500 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-08f3dccd-cff9-43a0-a34a-e3d223f60073 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.612433 Nov 22 16:51:36.955421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 346/702] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:51:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 1615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:51:36.965372 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d9cf64ff-dc8c-4c2e-9d1f-0f0c32e8f1a4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:36.966153 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d9cf64ff-dc8c-4c2e-9d1f-0f0c32e8f1a4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:37.043279 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d9cf64ff-dc8c-4c2e-9d1f-0f0c32e8f1a4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:37.055645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d9cf64ff-dc8c-4c2e-9d1f-0f0c32e8f1a4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1093 microversion: 2.1 time: 0.094106 Nov 22 16:51:37.056637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 347/703] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:36 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1093 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:37.910608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-81885ca2-865a-4559-a702-049b40fe48f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 2.577158 Nov 22 16:51:37.911860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 357/704] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:35 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 2580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:38.074016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:38.075660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:38.084922 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:38.085738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:38.086783 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:38.087513 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:38.185659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:38.198456 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1efb4aa3-1f62-45dd-820c-15626414732d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1135 microversion: 2.1 time: 0.128072 Nov 22 16:51:38.205819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 348/705] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:38 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1135 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:39.221625 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:39.222822 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:39.231219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:39.242185 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:39.244298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:39.249278 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:39.440267 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:39.441278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:39.456690 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:39.457208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:39.458312 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:39.459000 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:39.511169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:39.523002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-274d6204-0603-4fee-a763-5102f511edbc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1209 microversion: 2.1 time: 0.306168 Nov 22 16:51:39.534721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 349/706] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:39 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1209 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:39.575348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b865ff6d-6a43-495a-a429-c7a803602d02 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 0.655982 Nov 22 16:51:39.576430 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 358/707] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:38 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:40.542961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:40.543561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:40.556038 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:40.556822 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:40.557643 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:40.558078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:40.590333 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:40.593103 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:40.615813 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:40.616426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:40.621125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:40.621798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:40.778336 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8a3715e3-65a7-4660-b3da-d7256149769c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 0.193068 Nov 22 16:51:40.782558 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 359/708] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:40 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:41.048710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:41.068403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-81d16900-684c-4c0f-8f17-f49f68a71593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.531239 Nov 22 16:51:41.088460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 350/709] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:40 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:41.661190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-40a62c43-cae0-43fe-8088-4a93aaccd302 req-547c9a8f-17a7-4e76-828e-e348c9391e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4565565d-eecf-4bc1-8f80-5b7098b1ee3c", "tag": "b43cbd76-1406-4b6b-bd9d-fbd30b43b398"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:41.666489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:41.666489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:51:41.714492 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-40a62c43-cae0-43fe-8088-4a93aaccd302 req-547c9a8f-17a7-4e76-828e-e348c9391e9a service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:41.715194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-40a62c43-cae0-43fe-8088-4a93aaccd302 req-547c9a8f-17a7-4e76-828e-e348c9391e9a service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:41.765826 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-40a62c43-cae0-43fe-8088-4a93aaccd302 req-547c9a8f-17a7-4e76-828e-e348c9391e9a service nova] Creating event network-changed:b43cbd76-1406-4b6b-bd9d-fbd30b43b398 for instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c on hv-cinder-80473 Nov 22 16:51:41.790448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:41.791338 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-40a62c43-cae0-43fe-8088-4a93aaccd302 req-547c9a8f-17a7-4e76-828e-e348c9391e9a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317150 Nov 22 16:51:41.791629 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:41.795063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 360/710] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:41.809499 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:41.809962 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:41.816325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:41.817025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:41.945109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4c9d4bb5-2fdc-4eec-bab1-df6e028cd5bd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 14 microversion: 2.20 time: 0.158274 Nov 22 16:51:41.945663 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 351/711] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:41 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:42.095494 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:42.096468 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:42.116256 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:42.116948 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:42.118052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:42.120495 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:42.479357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:42.497124 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-57992604-26a1-449c-a2a1-10c48f51f239 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.404695 Nov 22 16:51:42.497892 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 361/712] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:42 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:42.962032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:42.963723 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:42.982069 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:42.985005 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:42.988539 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:42.989557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:43.115511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-333de98d-53c9-41ed-98c6-375a15160c01 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 13583 microversion: 2.20 time: 0.161027 Nov 22 16:51:43.116579 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 352/713] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:42 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 13583 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:43.515570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:43.516611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:43.535327 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:43.536030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:43.537017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:43.537631 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:43.803861 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:43.812225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5e24c849-33e7-40f8-878c-e943b73cda19 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.300582 Nov 22 16:51:43.818846 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 362/714] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:43 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:44.129453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:44.130722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:44.137531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:44.138280 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:44.139292 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:44.139992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:44.265198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-33ff276a-4b39-4f8d-b498-7255bf37f899 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 18498 microversion: 2.20 time: 0.140453 Nov 22 16:51:44.265828 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 353/715] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:44 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 18498 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:44.386739 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8373ea09-7949-4fd8-be83-c6eee7ebd00b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Action: 'create', calling method: .version_select at 0x7fc695502700>, body: {"keypair": {"name": "tempest-TestShelveInstance-155879003"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:44.401297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-8373ea09-7949-4fd8-be83-c6eee7ebd00b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Getting quotas for project 9a162bba81c545e78b24734acd4f95e5. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:44.405087 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-8373ea09-7949-4fd8-be83-c6eee7ebd00b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Getting quotas for user 04b3ae21dd4f4202996b0a99416ef766 and project 9a162bba81c545e78b24734acd4f95e5. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:44.693083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-8373ea09-7949-4fd8-be83-c6eee7ebd00b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Getting quotas for project 9a162bba81c545e78b24734acd4f95e5. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:51:44.697242 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-8373ea09-7949-4fd8-be83-c6eee7ebd00b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Getting quotas for user 04b3ae21dd4f4202996b0a99416ef766 and project 9a162bba81c545e78b24734acd4f95e5. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:51:44.717693 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8373ea09-7949-4fd8-be83-c6eee7ebd00b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.526948 Nov 22 16:51:44.718640 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 363/716] 10.222.0.61 () {60 vars in 1157 bytes} [Mon Nov 22 16:51:44 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:44.830955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:44.831917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:44.852955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:44.853751 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:44.862803 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:44.863865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:45.277401 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:45.278772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:45.285597 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:45.286062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:45.286926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:45.287370 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:45.345948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:45.355705 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-759bb654-8843-4833-8497-59f126088e5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.529280 Nov 22 16:51:45.356879 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 354/717] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:44 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:45.400258 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5078a3e9-6740-43bf-9aef-17e072e987ea tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 19342 microversion: 2.20 time: 0.126365 Nov 22 16:51:45.401068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 364/718] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:45 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 19342 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:51:46.373080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:46.373686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:46.380832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:46.381331 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:46.382068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:46.382505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:46.416294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:46.418338 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:46.428499 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:46.429483 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:46.431192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:46.432854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:46.536404 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-712c7f00-e8eb-46e4-925f-b34e299bccbd tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 22168 microversion: 2.20 time: 0.125643 Nov 22 16:51:46.537052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 365/719] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:46 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 22168 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:51:46.566837 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:46.574955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7e031283-6970-4c49-8ca4-76954ae01b04 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.205334 Nov 22 16:51:46.575990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 355/720] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:46 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:47.548881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:47.550364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:47.559309 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:47.559797 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:47.560607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:47.561035 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:47.597432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:47.598244 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:47.604904 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:47.605273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:47.606276 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:47.606972 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:47.670916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-bcffac29-535e-4020-846b-63d1d6769502 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 23803 microversion: 2.20 time: 0.125142 Nov 22 16:51:47.677040 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 366/721] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:47 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 23803 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:47.785924 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:47.795229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-42ac05d4-3497-4e27-a072-3936ad89c1a2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.204099 Nov 22 16:51:47.795628 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 356/722] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:47 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:48.688857 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:48.689906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:48.696871 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:48.697321 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:48.698103 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:48.698532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:48.804509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7e82ed1e-9291-468d-8124-d18f4debc751 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 24889 microversion: 2.20 time: 0.120058 Nov 22 16:51:48.805284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 367/723] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:48 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 24889 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:48.819024 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:48.819649 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:48.826335 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:48.826792 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:48.827598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:48.828183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:48.986827 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:48.996380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-20dd3de6-b336-4f44-a9b5-c507df1be4b2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.180851 Nov 22 16:51:48.996970 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 357/724] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:48 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:49.825632 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:49.826961 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:49.834995 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:49.835612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:49.836456 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:49.836878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:49.958111 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cb3b0b0f-2a96-406d-8b6c-115bf5748943 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 26185 microversion: 2.20 time: 0.140647 Nov 22 16:51:49.959639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 368/725] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:49 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 26185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:50.013448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:50.014911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:50.021983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:50.022626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:50.023600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:50.024249 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:50.222117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:50.231261 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5357e33c-93ce-4f8b-b022-e8459edc1414 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.221311 Nov 22 16:51:50.232070 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 358/726] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:50 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:50.975642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:50.976687 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:50.983951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:50.984498 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:50.985900 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:50.986337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:51.092885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fa9e0404-e47e-4532-b0d7-0783b0d25eff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 27122 microversion: 2.20 time: 0.121064 Nov 22 16:51:51.093479 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 369/727] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:50 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 27122 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:51.186210 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-14e29d87-e547-406e-805b-918a18b2af2e req-806dec50-df0e-408c-8e7d-9755fa69e8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4565565d-eecf-4bc1-8f80-5b7098b1ee3c", "name": "network-vif-plugged", "status": "completed", "tag": "b43cbd76-1406-4b6b-bd9d-fbd30b43b398"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:51.188711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:51.188711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:51:51.200290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-14e29d87-e547-406e-805b-918a18b2af2e req-806dec50-df0e-408c-8e7d-9755fa69e8b3 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:51.200290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-14e29d87-e547-406e-805b-918a18b2af2e req-806dec50-df0e-408c-8e7d-9755fa69e8b3 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:51.218594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-14e29d87-e547-406e-805b-918a18b2af2e req-806dec50-df0e-408c-8e7d-9755fa69e8b3 service nova] Creating event network-vif-plugged:b43cbd76-1406-4b6b-bd9d-fbd30b43b398 for instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c on hv-cinder-80473 Nov 22 16:51:51.224401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-14e29d87-e547-406e-805b-918a18b2af2e req-806dec50-df0e-408c-8e7d-9755fa69e8b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044346 Nov 22 16:51:51.224997 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 359/728] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:51.254671 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:51.255394 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:51.263105 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:51.263877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:51.264894 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:51.265330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:51.454520 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:51.466604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d6f98bf2-8a9c-49a7-90e5-12f03b57036d tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.220366 Nov 22 16:51:51.467727 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 370/729] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:51 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:52.108715 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:52.110453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:52.120344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:52.121169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:52.122382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:52.123054 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:52.251752 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-08746664-a020-4ae1-b65c-e725df60b2c7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 27659 microversion: 2.20 time: 0.148591 Nov 22 16:51:52.252893 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 360/730] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:52 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 27659 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:52.486063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:52.487021 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:52.493516 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:52.493966 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:52.494774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:52.495208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:52.649557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:52.657532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-68ec6242-2716-475a-873f-cbdcb98914ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1265 microversion: 2.1 time: 0.175909 Nov 22 16:51:52.658225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 371/731] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:52 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:51:53.264813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:53.265733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:53.273063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:53.273508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:53.274302 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:53.274734 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:53.380637 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-abf832b1-94d4-4350-9df5-0f69f8e1af06 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 27967 microversion: 2.20 time: 0.119767 Nov 22 16:51:53.381307 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 361/732] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:53 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 27967 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:53.678370 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:53.679055 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:53.685360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:53.685798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:53.686582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:53.687008 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:53.834348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:53.846391 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2e5194ed-e542-439a-be3e-bd4e878cb9aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1452 microversion: 2.1 time: 0.171369 Nov 22 16:51:53.847286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 372/733] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:53 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:53.865841 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:51:53.866537 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:53.873509 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:53.873956 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:53.874772 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:53.875201 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:54.037313 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:51:54.046690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-72426a98-c54c-4da8-9c0d-7372332b14dc tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1452 microversion: 2.1 time: 0.184910 Nov 22 16:51:54.047341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 362/734] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:51:53 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:51:54.399200 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:54.400867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:54.411790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:54.412636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:54.414067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:54.414871 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:54.543111 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-510999f5-8f4c-4133-8867-0154cc7b34f9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 28187 microversion: 2.20 time: 0.152938 Nov 22 16:51:54.544349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 373/735] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:54 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 28187 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:51:55.558231 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:55.559328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:55.566899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:55.567450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:55.568421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:55.568865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:55.698661 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3f3f2714-5a99-413b-87fb-11a9ae757240 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 28312 microversion: 2.20 time: 0.145164 Nov 22 16:51:55.702736 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 363/736] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:55 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 28312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:56.538568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-fc4ef98c-95cc-4dfd-9532-a48c575a7e94 req-a887b9d0-ec48-431f-8dd5-15b1de901fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4565565d-eecf-4bc1-8f80-5b7098b1ee3c", "tag": "b43cbd76-1406-4b6b-bd9d-fbd30b43b398"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:56.540102 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:51:56.540102 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:51:56.548342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-fc4ef98c-95cc-4dfd-9532-a48c575a7e94 req-a887b9d0-ec48-431f-8dd5-15b1de901fb8 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:56.548706 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-fc4ef98c-95cc-4dfd-9532-a48c575a7e94 req-a887b9d0-ec48-431f-8dd5-15b1de901fb8 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:56.562589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-fc4ef98c-95cc-4dfd-9532-a48c575a7e94 req-a887b9d0-ec48-431f-8dd5-15b1de901fb8 service nova] Creating event network-changed:b43cbd76-1406-4b6b-bd9d-fbd30b43b398 for instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c on hv-cinder-80473 Nov 22 16:51:56.570307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-fc4ef98c-95cc-4dfd-9532-a48c575a7e94 req-a887b9d0-ec48-431f-8dd5-15b1de901fb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041026 Nov 22 16:51:56.571262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 374/737] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:51:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:51:56.711496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:56.712702 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:56.720432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:56.721298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:56.722466 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:56.723086 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:56.854901 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ad942269-e79d-4b42-b3a5-72da37f39e2e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 28478 microversion: 2.20 time: 0.147203 Nov 22 16:51:56.856281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 364/738] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:56 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 28478 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:51:57.869976 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:57.871006 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:57.878712 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:57.879317 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:57.880229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:57.881210 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:57.986252 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0fb6ec84-77bb-4e2e-a67e-c02566016fa3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 28646 microversion: 2.20 time: 0.120717 Nov 22 16:51:57.986921 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 375/739] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:57 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 28646 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:51:59.000879 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:51:59.002088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:51:59.009553 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:59.010025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:59.010881 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:51:59.011343 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:51:59.102290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-06316172-6e8f-44cc-8784-a596103f9b0c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 28646 microversion: 2.20 time: 0.106491 Nov 22 16:51:59.102948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 365/740] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:51:58 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 28646 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:00.116408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:00.117376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:00.124939 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:00.126296 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:00.127211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:00.127643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:00.222793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-16c298aa-6510-4582-a0fc-c384127d8c45 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 28646 microversion: 2.20 time: 0.111006 Nov 22 16:52:00.223403 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 376/741] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:00 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 28646 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:01.236485 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:01.237511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:01.244665 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:01.245168 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:01.245991 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:01.246427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:01.352381 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0c4cb585-2111-474e-a025-78cfef7accc8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 29322 microversion: 2.20 time: 0.120879 Nov 22 16:52:01.353282 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 366/742] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:01 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 29322 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:52:02.365608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:02.366633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:02.373642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:02.374085 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:02.374870 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:02.376100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:02.475349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3ab31867-4f15-4a5c-8da6-ff0d7d9620c9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 31179 microversion: 2.20 time: 0.113775 Nov 22 16:52:02.476016 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 377/743] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:02 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 31179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:03.487597 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:03.488616 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:03.495660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:03.496130 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:03.497493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:03.497493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:03.546315 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1712040404", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-155879003", "security_groups": [{"name": "tempest-secgroup-smoke-620114993"}], "networks": [{"uuid": "e6b739b1-4c41-4bc1-aec5-57261982f83f"}], "block_device_mapping_v2": [{"uuid": "46a92001-59cf-4b3a-b318-3999805c7365", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:03.590721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c7176fc7-daba-4273-8b46-279ec664d0ff tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 32885 microversion: 2.20 time: 0.107368 Nov 22 16:52:03.592990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 367/744] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:03 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 32885 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:03.672512 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] validate_networks() for [('e6b739b1-4c41-4bc1-aec5-57261982f83f', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:52:04.140807 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:52:04.141789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:52:04.142268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:52:04.142677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:52:04.143089 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:52:04.152084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:04.152561 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:04.153382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:04.153821 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:04.172457 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Getting quotas for project 9a162bba81c545e78b24734acd4f95e5. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:52:04.177182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Getting quotas for user 04b3ae21dd4f4202996b0a99416ef766 and project 9a162bba81c545e78b24734acd4f95e5. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:52:04.237081 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:52:04.239344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='46a92001-59cf-4b3a-b318-3999805c7365',volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:52:04.380851 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-28deb74a-aba8-4b33-98fe-67305156ae5b tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.838151 Nov 22 16:52:04.381271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 378/745] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:52:03 2021] POST /compute/v2.1/servers => generated 405 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 16:52:04.395177 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8a1cfc4c-f53a-49e5-93a1-7506be204d39 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:04.396455 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8a1cfc4c-f53a-49e5-93a1-7506be204d39 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:04.457412 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8a1cfc4c-f53a-49e5-93a1-7506be204d39 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:04.464046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8a1cfc4c-f53a-49e5-93a1-7506be204d39 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1088 microversion: 2.1 time: 0.075440 Nov 22 16:52:04.464903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 368/746] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:04 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:04.606199 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:04.608018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:04.618433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:04.618935 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:04.620965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:04.620965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:04.744222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-64fb69bc-0b7c-4017-a0f3-ee8df7572a83 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 34186 microversion: 2.20 time: 0.144259 Nov 22 16:52:04.745898 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 379/747] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:04 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 34186 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:05.482269 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:05.483241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:05.491195 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:05.491701 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:05.492575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:05.492954 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:05.564740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:05.574319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-701d6204-8d94-4550-bbf4-c76986bae9e2 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1194 microversion: 2.1 time: 0.094880 Nov 22 16:52:05.574319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 369/748] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:05 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:05.756901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:05.758264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:05.766671 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:05.767187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:05.768096 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:05.768542 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:05.874664 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-48043303-8d1a-4116-b4ae-769f2e1fbab4 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 35035 microversion: 2.20 time: 0.121603 Nov 22 16:52:05.875677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 380/749] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:05 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 35035 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:06.591379 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:06.592289 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:06.603795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:06.604617 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:06.605643 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:06.606323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:06.789758 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:06.797564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a1c77a9d-1e8a-49d9-a5cf-b6300ef98285 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.209985 Nov 22 16:52:06.798306 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 370/750] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:06 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:06.887119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:06.888800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:06.896647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:06.897099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:06.897881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:06.898314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:06.999084 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4df6083f-eedb-433c-ad38-df9a5fe6eb9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 36149 microversion: 2.20 time: 0.115128 Nov 22 16:52:06.999640 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 381/751] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:06 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 36149 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:52:07.261776 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-6378e376-2352-4f38-ae16-892200746aa1 req-fef07c1f-3a72-421c-9f82-4c5782e2db8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:07.264294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:52:07.264294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:52:07.284843 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-6378e376-2352-4f38-ae16-892200746aa1 req-fef07c1f-3a72-421c-9f82-4c5782e2db8f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:07.288329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-6378e376-2352-4f38-ae16-892200746aa1 req-fef07c1f-3a72-421c-9f82-4c5782e2db8f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:07.304957 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-6378e376-2352-4f38-ae16-892200746aa1 req-fef07c1f-3a72-421c-9f82-4c5782e2db8f service nova] Creating event network-changed:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:52:07.310081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-6378e376-2352-4f38-ae16-892200746aa1 req-fef07c1f-3a72-421c-9f82-4c5782e2db8f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052557 Nov 22 16:52:07.311007 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 371/752] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:52:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:52:07.816130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:07.817131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:07.824591 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:07.825032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:07.825820 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:07.826244 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:07.990475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:07.998325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a7c13083-56a8-4f62-aaf1-825578e6ceab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.186742 Nov 22 16:52:07.998912 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 382/753] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:07 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:08.012874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:08.014188 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:08.020856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:08.021319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:08.022123 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:08.022561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:08.145315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b6f4c2ce-a251-4f1e-b5c5-b8095451d194 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 37643 microversion: 2.20 time: 0.136771 Nov 22 16:52:08.146340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 372/754] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:08 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 37643 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:09.018725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:09.019337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:09.025726 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:09.026184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:09.026969 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:09.027400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:09.158911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:09.159995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:09.167131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:09.167588 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:09.168454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:09.168680 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:09.168872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:09.177490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0d8b375e-52c8-4a8c-9643-a9fc718ce2d8 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.163690 Nov 22 16:52:09.178058 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 383/755] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:09 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:09.273035 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9463e5c0-6b0d-4ce9-bdea-77c9236da961 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 38200 microversion: 2.20 time: 0.118188 Nov 22 16:52:09.273606 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 373/756] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:09 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 38200 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:10.198266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:10.199265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:10.210360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:10.211023 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:10.212388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:10.213110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:10.286340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:10.287353 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:10.294831 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:10.295294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:10.296113 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:10.296560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:10.398721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4b429a95-a870-455b-b4f9-2eac06e34e0a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 38200 microversion: 2.20 time: 0.116982 Nov 22 16:52:10.399384 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 374/757] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:10 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 38200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:52:10.407647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:10.418620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cd390246-6283-46cb-acf0-ed5ea10e6093 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.226164 Nov 22 16:52:10.419546 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 384/758] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:10 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:11.411649 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:11.412669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:11.419437 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:11.419929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:11.420694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:11.421126 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:11.440937 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:11.441560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:11.447858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:11.448314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:11.449117 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:11.449549 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:11.518864 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-17bdb8db-94e7-46fd-9e64-fe593d418ce7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 38200 microversion: 2.20 time: 0.111640 Nov 22 16:52:11.520942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 375/759] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:11 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 38200 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:11.583071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:11.590636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6586200e-123d-4197-9e9a-11a3ee2dae10 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.153504 Nov 22 16:52:11.591206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 385/760] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:11 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:52:12.532524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:12.533517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:12.540413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:12.540862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:12.541640 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:12.542081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:12.606910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:12.607510 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:12.614094 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:12.614542 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:12.615314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:12.615747 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:12.640106 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6b3908fb-ac1e-464d-8bab-247b5da41e9f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 38219 microversion: 2.20 time: 0.111906 Nov 22 16:52:12.641032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 376/761] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:12 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 38219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:12.751612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:12.758837 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ec2e09d0-7952-42dd-8393-c74f87aa00d6 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.156163 Nov 22 16:52:12.759396 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 386/762] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:12 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:52:13.653344 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:13.654497 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:13.661263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:13.661706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:13.662486 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:13.662924 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:13.756256 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d8e2655a-35e9-4934-a012-72bcf1fbd9fe tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 200 len: 38343 microversion: 2.20 time: 0.106948 Nov 22 16:52:13.757245 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 377/763] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:13 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 38343 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:52:13.767114 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:13.767614 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:13.774554 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:13.774995 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:13.775762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:13.776222 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:13.777400 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:13.778090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:13.787179 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:13.787634 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:13.788641 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:13.789108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:13.800851 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3bc82206-a1f8-442c-80a9-d31c6810077d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/ips" status: 200 len: 152 microversion: 2.20 time: 0.037256 Nov 22 16:52:13.806610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 387/764] 10.222.0.61 () {60 vars in 1288 bytes} [Mon Nov 22 16:52:13 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:52:13.933598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:13.941289 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-174ea7f2-e064-46a0-a242-8d4eb44bdbfa tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.168591 Nov 22 16:52:13.941859 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 378/765] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:13 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:14.958837 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:14.959481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:14.966560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:14.967118 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:14.968106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:14.968629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:15.115318 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:15.122723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e4c92b00-b8e4-4f40-80c6-04ab0df6a016 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.167729 Nov 22 16:52:15.123298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 388/766] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:14 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:15.974000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:15.974544 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:15.981075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:15.981529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:15.982311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:15.982749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:16.006103 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lazy-loading 'flavor' on Instance uuid 16597aed-cea9-43fd-9101-27ea3c55b6c3 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:52:16.140166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:16.140908 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:16.147503 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:16.148002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:16.148785 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:16.149220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:16.259003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1750670d-89fa-4d7f-9c6c-eb32ff6bd8a0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 202 len: 0 microversion: 2.20 time: 0.288626 Nov 22 16:52:16.262992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 379/767] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:15 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:52:16.268275 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:16.268974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:16.275475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:16.275930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:16.276978 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:16.277449 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:16.305719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:16.316179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7df89d57-9bf8-441e-80f6-17c6bcb8098e tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.179145 Nov 22 16:52:16.317527 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 389/768] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:16 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:52:16.427850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:16.436922 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:16.438560 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:16.439716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6cc07941-cfbd-4708-8a59-f90a9435158f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.175353 Nov 22 16:52:16.440322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 380/769] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:16 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:17.333503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:17.334176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:17.341467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:17.342064 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:17.342972 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:17.343399 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-d42da1ff-62e7-48eb-8e50-6e2e88aa9e0c req-37902d29-206b-4861-8559-9436196bfa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "name": "network-vif-plugged", "status": "completed", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:17.343960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:17.345489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:52:17.345489 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:52:17.353051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d42da1ff-62e7-48eb-8e50-6e2e88aa9e0c req-37902d29-206b-4861-8559-9436196bfa7b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:17.353837 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d42da1ff-62e7-48eb-8e50-6e2e88aa9e0c req-37902d29-206b-4861-8559-9436196bfa7b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:17.371140 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-d42da1ff-62e7-48eb-8e50-6e2e88aa9e0c req-37902d29-206b-4861-8559-9436196bfa7b service nova] Creating event network-vif-plugged:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:52:17.376783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-d42da1ff-62e7-48eb-8e50-6e2e88aa9e0c req-37902d29-206b-4861-8559-9436196bfa7b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097093 Nov 22 16:52:17.377490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 390/770] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:52:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:52:17.459116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:17.459979 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:17.466357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:17.466873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:17.467738 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:17.468267 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:17.486000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:17.494170 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-933979cc-9663-425c-8bae-04e6960e1dec tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.164081 Nov 22 16:52:17.495955 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 381/771] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:17 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:52:17.606719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:17.615960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:17.617462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:17.618607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1ca99626-1bba-46b1-8898-e7973d2997a5 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.163586 Nov 22 16:52:17.619164 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 391/772] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:17 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:52:18.510767 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:18.511376 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:18.518989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:18.519438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:18.520262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:18.520700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:18.637362 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:18.637953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:18.644608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:18.645053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:18.645832 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:18.646264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:18.656182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:18.663732 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-16ff8044-be6d-4f1f-8cc1-97d08361eb0f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1259 microversion: 2.1 time: 0.156772 Nov 22 16:52:18.664333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 382/773] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:18 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:18.784450 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:18.793566 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:18.795053 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:18.796251 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b22e268d-e9c7-42ed-8320-b7c54ecbbaf0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.162566 Nov 22 16:52:18.797343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 392/774] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:18 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:52:19.681694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:19.682309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:19.689404 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:19.689854 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:19.690671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:19.691106 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:19.815392 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:19.816029 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:19.822037 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:19.822488 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:19.823275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:19.823712 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:19.824471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:19.833687 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-21999657-beba-4a16-9dc3-533316dc64d3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1443 microversion: 2.1 time: 0.155584 Nov 22 16:52:19.834265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 383/775] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:19 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:19.850300 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:19.850902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:19.856739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:19.857183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:19.857961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:19.858392 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:20.015229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:20.023740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:20.025242 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:20.026376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aecfcf99-8828-4403-940c-ac6cdd870d89 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.215217 Nov 22 16:52:20.026928 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 393/776] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:19 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:52:20.041449 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:20.048688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7362d27c-c4de-47cb-b1e5-70eac8f591bc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1443 microversion: 2.1 time: 0.202128 Nov 22 16:52:20.049245 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 384/777] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:52:19 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1443 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:52:21.046515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:21.049263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:21.056782 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:21.057345 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:21.058428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:21.058995 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:21.209527 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:21.217698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:21.219686 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:21.220909 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0ba0d9d4-5444-46da-8f89-675d749db8f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.179290 Nov 22 16:52:21.221471 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 394/778] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:21 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:22.240950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:22.242026 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:22.250666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:22.251267 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:22.252341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:22.252892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:22.342802 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-f39e760a-9e1a-44bc-9ce5-758b07fccb03 req-f9598592-85bc-4898-8cc5-216d89957f32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:22.345502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:52:22.345502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:52:22.357353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-f39e760a-9e1a-44bc-9ce5-758b07fccb03 req-f9598592-85bc-4898-8cc5-216d89957f32 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:22.357800 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-f39e760a-9e1a-44bc-9ce5-758b07fccb03 req-f9598592-85bc-4898-8cc5-216d89957f32 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:22.371618 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-f39e760a-9e1a-44bc-9ce5-758b07fccb03 req-f9598592-85bc-4898-8cc5-216d89957f32 service nova] Creating event network-changed:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:52:22.390412 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-f39e760a-9e1a-44bc-9ce5-758b07fccb03 req-f9598592-85bc-4898-8cc5-216d89957f32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051807 Nov 22 16:52:22.391636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 395/779] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:52:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:52:22.428429 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:22.436274 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:22.438155 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:22.439627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2b8f04be-0abc-4ed0-8b11-671d76008f72 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.203759 Nov 22 16:52:22.440220 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 385/780] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:22 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:23.462245 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:23.466936 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:23.477918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:23.478216 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:23.479173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:23.479612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:23.649779 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:23.659545 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:23.661299 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:23.662718 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0560be41-cdc1-48a4-9336-182a6b249f8d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.207768 Nov 22 16:52:23.663351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 396/781] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:23 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:24.682558 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:24.683181 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:24.690296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:24.690753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:24.691536 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:24.692077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:24.830031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:24.837914 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:24.839662 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:24.840850 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4ef1187c-36bd-4db8-b9a2-d748163e1d11 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.162097 Nov 22 16:52:24.841401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 386/782] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:24 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:25.859088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:25.860597 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:25.867101 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:25.867543 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:25.868358 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:25.868788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:26.006210 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:26.015091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:26.017991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:26.020870 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7a0bba95-24fb-46d2-9bde-8a0122a3b8ce tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.164769 Nov 22 16:52:26.021447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 397/783] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:25 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:52:27.040502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:27.041115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:27.048299 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:27.048752 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:27.049545 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:27.051019 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:27.189899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:27.197659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:27.199227 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:27.200351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1c63516b-7c76-4fe5-90b4-5f6f7a6bd08e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1744 microversion: 2.20 time: 0.163548 Nov 22 16:52:27.200900 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 387/784] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:27 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:28.220580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:28.222175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:28.227439 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:28.227923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:28.228713 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:28.229147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:28.362441 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:28.370275 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:28.371746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:28.372919 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-44aa835d-9f98-41e6-94cd-c0bce090e08d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1744 microversion: 2.20 time: 0.156894 Nov 22 16:52:28.373472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 398/785] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:28 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:29.395940 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:29.396627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:29.409324 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:29.410375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:29.411900 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:29.413613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:29.415161 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-2e845a44-e229-4a0c-8b86-853cc0329baf req-10326601-bdcf-45d8-876d-8832527eec28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "name": "network-vif-plugged", "status": "completed", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:29.423268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:52:29.423268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:52:29.473607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2e845a44-e229-4a0c-8b86-853cc0329baf req-10326601-bdcf-45d8-876d-8832527eec28 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:29.478737 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2e845a44-e229-4a0c-8b86-853cc0329baf req-10326601-bdcf-45d8-876d-8832527eec28 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:29.503693 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-2e845a44-e229-4a0c-8b86-853cc0329baf req-10326601-bdcf-45d8-876d-8832527eec28 service nova] Creating event network-vif-plugged:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:52:29.509683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-2e845a44-e229-4a0c-8b86-853cc0329baf req-10326601-bdcf-45d8-876d-8832527eec28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101788 Nov 22 16:52:29.513906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 399/786] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:52:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:52:29.633202 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:29.641823 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:29.643665 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:29.645242 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-180193d6-100f-44d7-b404-16279494b0fa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.257870 Nov 22 16:52:29.645981 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 388/787] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:29 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:30.669378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:30.671377 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:30.679579 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:30.680194 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:30.681484 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:30.682442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:30.893855 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:30.902975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:30.904583 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:30.909462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f9d1572d-1fc8-4880-8d5e-29c5d6fdd39d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.240888 Nov 22 16:52:30.909462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 400/788] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:30 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:31.927171 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:31.928022 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:31.934664 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:31.935120 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:31.935944 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:31.936384 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:32.086146 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:32.095572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:32.097251 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:32.098624 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a70be83b-3d7a-458b-b329-3c9110b270e0 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.175505 Nov 22 16:52:32.099977 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 389/789] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:31 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:33.119021 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:33.119633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:33.128804 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:33.129665 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:33.130845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:33.131501 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:33.325697 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:33.340515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:33.344038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:33.348480 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f8d43b74-6e5c-4bab-977c-1720542c3d81 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.233137 Nov 22 16:52:33.356265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 401/790] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:33 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:34.387188 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:34.388161 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:34.400014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:34.400787 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:34.402083 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:34.402716 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:34.562167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:34.571494 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:34.573078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:34.574325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f80e0aaf-d4d8-4d18-b5f8-1a22919dcd40 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.201148 Nov 22 16:52:34.574913 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 390/791] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:34 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:35.594990 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:35.596116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:35.603841 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:35.604339 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:35.605106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:35.605540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:35.783943 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:35.792660 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:35.794175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:35.795413 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e7b9d0a8-a95a-46e7-bb73-8a0a55264206 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.205337 Nov 22 16:52:35.800104 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 402/792] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:35 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:36.814807 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:36.815720 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:36.825933 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:36.826426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:36.827225 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:36.828592 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:37.000989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:37.009149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:37.010650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:37.014361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c0ba1ec7-b7eb-415d-8ab8-9582735d733c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.201923 Nov 22 16:52:37.014361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 391/793] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:36 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:38.030427 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:38.031170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:38.037844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:38.038560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:38.039429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:38.039890 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:38.197206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:38.205738 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:38.207164 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:38.208348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-40805a1e-d2b1-4297-9f71-93af2dcde2a2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1739 microversion: 2.20 time: 0.181713 Nov 22 16:52:38.208910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 403/794] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:38 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:39.228046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:39.228645 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:39.236462 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:39.236911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:39.237709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:39.238142 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:39.396133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:39.405284 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:39.407314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:39.408514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-91704db2-a7ef-44bf-a8e7-a831bfb6803c tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1721 microversion: 2.20 time: 0.184328 Nov 22 16:52:39.409070 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 392/795] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:39 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:40.432415 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:40.433213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:40.440418 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:40.440867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:40.441666 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:40.442106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:40.586450 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:40.595555 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:40.597112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:40.598415 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-48cb1b22-0d5f-4b27-8b6d-af29aa4962f6 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1721 microversion: 2.20 time: 0.172024 Nov 22 16:52:40.598978 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 404/796] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:40 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:41.367383 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-581b405f-95f9-40d3-9317-59d41fe53403 req-32efd591-e0a9-4d5f-9288-6d95f6b490bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "name": "network-vif-unplugged", "status": "completed", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:41.369158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:52:41.369158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:52:41.377090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-581b405f-95f9-40d3-9317-59d41fe53403 req-32efd591-e0a9-4d5f-9288-6d95f6b490bd service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:41.377541 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-581b405f-95f9-40d3-9317-59d41fe53403 req-32efd591-e0a9-4d5f-9288-6d95f6b490bd service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:41.389109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-581b405f-95f9-40d3-9317-59d41fe53403 req-32efd591-e0a9-4d5f-9288-6d95f6b490bd service nova] Creating event network-vif-unplugged:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:52:41.395226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-581b405f-95f9-40d3-9317-59d41fe53403 req-32efd591-e0a9-4d5f-9288-6d95f6b490bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031307 Nov 22 16:52:41.396023 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 393/797] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:52:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:52:41.617298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:41.617839 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:41.624114 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:41.625672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:41.626474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:41.626914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:41.774088 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:41.783147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:41.785051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:41.786376 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9ce55375-dfe8-497c-b1d5-43f5cc33db5a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1724 microversion: 2.20 time: 0.172869 Nov 22 16:52:41.786960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 405/798] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:41 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:41.805442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "685ea965-9cd6-4c34-8a14-56cbf02d7866"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:41.806708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:41.814527 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:41.814984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:41.815779 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:41.816252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.133142 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-59863dad-8ffc-477f-b281-3b28ed66c23e tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.332243 Nov 22 16:52:42.133674 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 394/799] 10.222.0.61 () {62 vars in 1363 bytes} [Mon Nov 22 16:52:41 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-volume_attachments => generated 188 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:52:42.256367 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:42.256689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:42.262594 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:42.263035 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.263809 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:42.264269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.548183 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e9e4750f-cf35-4c58-9e3b-ba0d77303eec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-volume_attachments/685ea965-9cd6-4c34-8a14-56cbf02d7866" status: 202 len: 0 microversion: 2.20 time: 0.295722 Nov 22 16:52:42.549029 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 406/800] 10.222.0.61 () {60 vars in 1456 bytes} [Mon Nov 22 16:52:42 2021] DELETE /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-volume_attachments/685ea965-9cd6-4c34-8a14-56cbf02d7866 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:52:42.607088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:42.607689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:42.614844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:42.615304 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.616131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:42.616575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.704842 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-bc4e4ad4-5bb3-4ad1-b13c-c219f9cf2312 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action" status: 202 len: 0 microversion: 2.20 time: 0.102033 Nov 22 16:52:42.706184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 395/801] 10.222.0.61 () {62 vars in 1318 bytes} [Mon Nov 22 16:52:42 2021] POST /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:52:42.715648 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:42.716296 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:42.723457 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:42.723915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.724748 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:42.725164 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:42.884126 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:42.894533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:42.896038 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:42.897180 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-32165f85-643e-4d54-9c8d-1764c13ceacc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1672 microversion: 2.20 time: 0.185586 Nov 22 16:52:42.897733 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 407/802] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:42 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1672 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:43.916744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:43.917494 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:43.924328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:43.924780 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:43.925573 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:43.926009 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:44.063266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:44.071018 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:44.072520 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:44.073666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e3159748-a4c2-4a34-9f72-c60394c7b3e3 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.161283 Nov 22 16:52:44.074360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 396/803] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:43 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:45.094703 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:45.095503 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:45.102710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:45.103162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:45.104026 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:45.104448 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:45.268650 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:45.277688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:45.279162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:45.280353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ab90a9c0-ea20-45d4-acf8-2d079845ea92 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.190314 Nov 22 16:52:45.281197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 408/804] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:45 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:46.299803 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:46.300538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:46.307433 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:46.308030 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:46.309104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:46.309611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:46.493027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:46.504709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:46.506254 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:46.507574 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ca2c8191-cb12-4c4d-9c0d-520133d3779a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.212771 Nov 22 16:52:46.508464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 397/805] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:46 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:47.526926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:47.527596 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:47.534171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:47.534604 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:47.535383 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:47.535811 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:47.694997 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:47.704424 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:47.705941 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:47.707091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-72a14dfa-f4a2-4040-abe9-65abf401e857 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.183861 Nov 22 16:52:47.707655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 409/806] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:47 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:48.725622 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:48.726221 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:48.732731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:48.733183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:48.735016 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:48.735464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:48.878976 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:48.888545 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:48.890930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:48.892481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-931fca2d-acee-4460-be15-6fc111c8dddb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.170560 Nov 22 16:52:48.893163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 398/807] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:48 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:49.917347 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:49.918036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:49.929280 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:49.930060 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:49.931435 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:49.932235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:50.095769 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:50.106292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:50.108204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:50.110274 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-620e8c6a-ee08-4106-8b38-74a34ee87cd9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.202836 Nov 22 16:52:50.111264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 410/808] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:49 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:51.129133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:51.129941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:51.136141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:51.136586 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:51.137364 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:51.137798 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:51.314525 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:51.322685 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:51.324367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:51.325746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9dd9a094-87e8-4f3c-b087-e67c2514864a tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.200401 Nov 22 16:52:51.326311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 399/809] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:51 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:52:52.346542 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:52.347200 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:52.357293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:52.357818 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:52.359228 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:52.359672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:52.527972 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:52.541775 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:52.544649 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:52.546911 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2ad88f22-6e59-4435-9701-2ad62c7c129d tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.204881 Nov 22 16:52:52.549483 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 411/810] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:52 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:53.567403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:53.568053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:53.574492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:53.574943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:53.575744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:53.576265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:53.781048 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:53.790858 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:53.792400 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:53.793616 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a6bb6e5d-9a1f-431e-a020-f56331eef16b tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.230055 Nov 22 16:52:53.799160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 400/811] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:53 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:54.827607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:54.829970 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:54.835989 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:54.836440 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:54.837248 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:54.837679 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:55.007759 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:55.020235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:55.021896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:55.023293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e3f290d5-917d-41bd-bb29-e643a662d270 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.206099 Nov 22 16:52:55.024333 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 412/812] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:54 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:56.043535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:56.044257 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:56.051862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:56.052322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:56.053110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:56.053548 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:56.205026 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:56.215363 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:56.217752 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:56.220442 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cebce9d1-4c65-467a-852f-e314cdf66ec8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.180275 Nov 22 16:52:56.221368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 401/813] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:56 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:57.239988 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:57.240569 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:57.247250 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:57.247700 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:57.248505 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:57.249051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:57.425982 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:57.433694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:57.435169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:57.437600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5b228a5b-58f3-45cd-84bb-2b28ca49d052 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.200242 Nov 22 16:52:57.437600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 413/814] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:57 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:58.456796 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:58.457382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:58.463322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:58.463770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:58.464824 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:58.465258 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:58.601675 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:58.610001 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:58.611493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:58.612691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-99f99093-43ee-44d5-869c-7964be1bf9d9 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.160570 Nov 22 16:52:58.613262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 402/815] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:58 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:52:59.477867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-5c223e95-b858-4c5a-97d0-cb3341e64978 req-a02be77c-f766-4414-81c8-ab49423fedea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "name": "network-vif-plugged", "status": "completed", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:52:59.479386 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:52:59.479386 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:52:59.488122 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-5c223e95-b858-4c5a-97d0-cb3341e64978 req-a02be77c-f766-4414-81c8-ab49423fedea service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:59.488607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-5c223e95-b858-4c5a-97d0-cb3341e64978 req-a02be77c-f766-4414-81c8-ab49423fedea service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:59.500107 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-5c223e95-b858-4c5a-97d0-cb3341e64978 req-a02be77c-f766-4414-81c8-ab49423fedea service nova] Creating event network-vif-plugged:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:52:59.505119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-5c223e95-b858-4c5a-97d0-cb3341e64978 req-a02be77c-f766-4414-81c8-ab49423fedea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030838 Nov 22 16:52:59.505724 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 414/816] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:52:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:52:59.630649 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:52:59.631177 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:52:59.637580 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:59.638036 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:59.638832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:52:59.639323 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:52:59.783036 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:59.791654 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:59.793207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:52:59.794386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1aa28919-67f4-4135-ad1f-e9de2c3573de tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.167631 Nov 22 16:52:59.794952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 403/817] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:52:59 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:53:00.815204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:00.815994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:00.822196 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:00.822698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:00.823540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:00.824003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:00.974973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:00.988262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:00.991079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:00.991532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d5455127-5915-4a8f-9746-150801c6d5ec tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1730 microversion: 2.20 time: 0.181628 Nov 22 16:53:00.994045 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 415/818] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:53:00 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:53:02.019068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:02.019905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:02.027952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:02.028454 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:02.029252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:02.029687 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:02.166865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:02.176615 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:02.178151 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:02.179311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-72debaf0-da22-48e4-a97e-9b86de9d4129 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1717 microversion: 2.20 time: 0.164489 Nov 22 16:53:02.179878 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 404/819] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:53:02 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:53:30.994734 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:30.995652 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:31.002106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:31.002551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:31.003343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:31.003783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:31.037234 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-28621d69-a3cd-4d1d-a254-d3e1b4a86830 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046937 Nov 22 16:53:31.038072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 416/820] 10.222.0.61 () {60 vars in 1342 bytes} [Mon Nov 22 16:53:30 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:31.105391 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:31.105977 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:31.116289 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:31.117031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:31.118243 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:31.118849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:31.145961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Going to try to terminate instance {{(pid=133216) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:53:31.238339 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-38c676cd-3d1c-4916-aa52-16c41741ace2 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 204 len: 0 microversion: 2.20 time: 0.136199 Nov 22 16:53:31.239114 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 405/821] 10.222.0.61 () {60 vars in 1279 bytes} [Mon Nov 22 16:53:31 2021] DELETE /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 16:53:31.247211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:31.248039 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:31.256605 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:31.257047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:31.257891 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:31.258299 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:31.402732 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:31.411948 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:31.413414 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:31.414557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e713042c-3cb2-4514-9519-4c76a78b70f7 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.171406 Nov 22 16:53:31.415112 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 417/822] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:53:31 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 16:53:32.433896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:32.434600 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:32.441273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:32.441719 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:32.442513 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:32.442947 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:32.605099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:32.614223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:32.615739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:32.616931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e80d1826-3abd-4c61-a2dd-0c617a0569c1 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1723 microversion: 2.20 time: 0.187447 Nov 22 16:53:32.617491 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 406/823] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:53:32 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:53:33.639042 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:33.640395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:33.651100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:33.651857 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:33.653136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:33.654387 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:33.729052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:33.741207 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:33.744577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd7a9d997c1644148ba43d758c3e02ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7531002e08024f178aeaba0f112be50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:33.746153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-28359829-c01d-472d-81f7-c43403037ebb tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 200 len: 1656 microversion: 2.20 time: 0.113632 Nov 22 16:53:33.746940 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 418/824] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:53:33 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 1656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 16:53:33.791978 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-322e1e41-842c-493e-ac4d-188622f5d2c7 req-75aa7495-f155-4b41-84c1-441c0581de2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16597aed-cea9-43fd-9101-27ea3c55b6c3", "name": "network-vif-deleted", "tag": "6e04a4e7-144d-4d83-9b28-185254f5c719"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:53:33.793888 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:53:33.793888 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:53:33.813927 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-322e1e41-842c-493e-ac4d-188622f5d2c7 req-75aa7495-f155-4b41-84c1-441c0581de2f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:33.814887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-322e1e41-842c-493e-ac4d-188622f5d2c7 req-75aa7495-f155-4b41-84c1-441c0581de2f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:33.831386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-322e1e41-842c-493e-ac4d-188622f5d2c7 req-75aa7495-f155-4b41-84c1-441c0581de2f service nova] Creating event network-vif-deleted:6e04a4e7-144d-4d83-9b28-185254f5c719 for instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 on hv-cinder-80473 Nov 22 16:53:33.838334 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-322e1e41-842c-493e-ac4d-188622f5d2c7 req-75aa7495-f155-4b41-84c1-441c0581de2f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050468 Nov 22 16:53:33.841477 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 407/825] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:53:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:53:34.769449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:34.770786 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:34.780191 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:34.781128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:34.783022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:34.783022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:34.801391 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] HTTP exception thrown: Instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 could not be found. Nov 22 16:53:34.801988 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Returning 404 to user: Instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:53:34.802820 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2088d850-a832-44bb-b0df-066aa9bccd22 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 404 len: 111 microversion: 2.20 time: 0.037542 Nov 22 16:53:34.803645 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 419/826] 10.222.0.61 () {60 vars in 1276 bytes} [Mon Nov 22 16:53:34 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 22 16:53:34.814110 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ba640e77-5ee3-4970-b799-29ec184849dc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '.version_select at 0x7fc695ad7e50>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:34.838138 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ba640e77-5ee3-4970-b799-29ec184849dc tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403001559" status: 204 len: 0 microversion: 2.20 time: 0.028614 Nov 22 16:53:34.839030 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 408/827] 10.222.0.61 () {60 vars in 1258 bytes} [Mon Nov 22 16:53:34 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403001559 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 16:53:36.755393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:36.755966 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:36.763595 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:36.764354 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:36.765178 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:36.765595 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:36.779847 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] HTTP exception thrown: Instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 could not be found. Nov 22 16:53:36.780582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Returning 404 to user: Instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:53:36.781464 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5c2ebe16-8742-4c07-a7d6-a03893a3d393 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 404 len: 111 microversion: 2.1 time: 0.032280 Nov 22 16:53:36.782032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 420/828] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:53:36 2021] DELETE /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:53:36.791082 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:36.791836 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 16597aed-cea9-43fd-9101-27ea3c55b6c3] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:36.799169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:36.799631 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:36.800470 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:36.800909 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:36.814819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] HTTP exception thrown: Instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 could not be found. Nov 22 16:53:36.815446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Returning 404 to user: Instance 16597aed-cea9-43fd-9101-27ea3c55b6c3 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:53:36.816333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f78d6d3c-91c1-4e75-80cd-a62cb56407b8 tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3" status: 404 len: 111 microversion: 2.1 time: 0.029582 Nov 22 16:53:36.816906 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 409/829] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:36 2021] GET /compute/v2.1/servers/16597aed-cea9-43fd-9101-27ea3c55b6c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:53:37.960565 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:37.961081 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:37.968813 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:37.969261 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:37.970269 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:37.970706 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:37.988757 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] HTTP exception thrown: Instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 could not be found. Nov 22 16:53:37.989649 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Returning 404 to user: Instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:53:37.990685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b663082e-fb94-43a2-b734-56da2f7fc07f tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 404 len: 111 microversion: 2.1 time: 0.033827 Nov 22 16:53:37.991535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 421/830] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:53:37 2021] DELETE /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 16:53:38.000313 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:38.001085 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] [instance: 2cc37184-5ac8-4a2a-98b9-7eab6cf00413] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:38.007539 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:38.008167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:38.008974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:38.009413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:38.027814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] HTTP exception thrown: Instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 could not be found. Nov 22 16:53:38.028710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] Returning 404 to user: Instance 2cc37184-5ac8-4a2a-98b9-7eab6cf00413 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:53:38.030087 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-300e7cc4-2100-4163-8a57-0ca1df9b9caa tempest-AttachVolumeShelveTestJSON-250158158 tempest-AttachVolumeShelveTestJSON-250158158-project] 10.222.0.61 "GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413" status: 404 len: 111 microversion: 2.1 time: 0.034360 Nov 22 16:53:38.030652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 410/831] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:37 2021] GET /compute/v2.1/servers/2cc37184-5ac8-4a2a-98b9-7eab6cf00413 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:53:47.514357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2680df59-fc04-45c7-9e5e-30736451e587 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: .version_select at 0x7fc69525b3a0>, body: {"keypair": {"name": "tempest-keypair-1914323773"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:53:47.532266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-2680df59-fc04-45c7-9e5e-30736451e587 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:53:47.536918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-2680df59-fc04-45c7-9e5e-30736451e587 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for user df00753d984e4802a40872c78398aabb and project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:53:48.025585 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-2680df59-fc04-45c7-9e5e-30736451e587 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:53:48.029171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-2680df59-fc04-45c7-9e5e-30736451e587 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for user df00753d984e4802a40872c78398aabb and project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:53:48.041598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2680df59-fc04-45c7-9e5e-30736451e587 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.653589 Nov 22 16:53:48.042190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 422/832] 10.222.0.61 () {60 vars in 1157 bytes} [Mon Nov 22 16:53:47 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:49.386865 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-86135722", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a90a2625-3e1f-42ca-bb48-64439de3ab4b"}], "security_groups": [{"name": "tempest-securitygroup--1124317103"}], "key_name": "tempest-keypair-1914323773", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:53:49.497471 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] validate_networks() for [('a90a2625-3e1f-42ca-bb48-64439de3ab4b', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:53:49.917671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:53:49.918183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:53:49.918671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:53:49.919141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:53:49.919595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:53:49.929262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:49.929709 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:49.930556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:49.930984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:49.954067 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:53:49.958832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for user df00753d984e4802a40872c78398aabb and project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:53:49.971303 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:53:49.973588 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:53:50.022200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-759ecda3-5707-4839-95bb-9b95f69a34f3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.639624 Nov 22 16:53:50.023204 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 411/833] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:53:49 2021] POST /compute/v2.1/servers => generated 402 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:53:50.032498 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8a568c23-87bd-402a-8ecb-9b83f9eb575a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:50.033710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8a568c23-87bd-402a-8ecb-9b83f9eb575a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:50.102806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8a568c23-87bd-402a-8ecb-9b83f9eb575a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:50.113327 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8a568c23-87bd-402a-8ecb-9b83f9eb575a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1236 microversion: 2.1 time: 0.084447 Nov 22 16:53:50.115754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 423/834] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:50 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:53:51.132240 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:51.133758 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:51.141952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:51.142779 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:51.143877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:51.144395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:51.217584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:51.230995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-744d1a50-9b25-42a9-ae89-ceabf7998000 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1296 microversion: 2.1 time: 0.102967 Nov 22 16:53:51.235017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 412/835] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:51 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:52.249360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:52.250036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:52.256776 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:52.257229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:52.258204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:52.258603 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:52.408553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:52.416179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3d00bd6f-7b5d-4293-8269-1b1f5dbdc7c1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.171411 Nov 22 16:53:52.416757 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 424/836] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:52 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:52.558025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-694d1f2b-2e4e-4ccf-9049-cdce83901c16 req-14b3b57e-1ff7-4458-8fbd-0d4069ab0532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6517240b-6ef9-466c-88ac-6e73bd2f771c", "tag": "8fb0874e-fcbc-4cce-87ba-7923e791f22c"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:53:52.560556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:53:52.560556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:53:52.572658 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-694d1f2b-2e4e-4ccf-9049-cdce83901c16 req-14b3b57e-1ff7-4458-8fbd-0d4069ab0532 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:52.573517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-694d1f2b-2e4e-4ccf-9049-cdce83901c16 req-14b3b57e-1ff7-4458-8fbd-0d4069ab0532 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:52.599177 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-694d1f2b-2e4e-4ccf-9049-cdce83901c16 req-14b3b57e-1ff7-4458-8fbd-0d4069ab0532 service nova] Creating event network-changed:8fb0874e-fcbc-4cce-87ba-7923e791f22c for instance 6517240b-6ef9-466c-88ac-6e73bd2f771c on hv-cinder-80473 Nov 22 16:53:52.606549 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-694d1f2b-2e4e-4ccf-9049-cdce83901c16 req-14b3b57e-1ff7-4458-8fbd-0d4069ab0532 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064031 Nov 22 16:53:52.607290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 413/837] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:53:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:53:53.434247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:53.435549 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:53.442190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:53.442643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:53.443467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:53.443948 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:53.579633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:53.587067 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-05176e8a-86db-4703-959d-bb42a0065855 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.156426 Nov 22 16:53:53.587642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 425/838] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:53 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:54.606063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:54.607402 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:54.613717 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:54.614162 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:54.614949 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:54.615380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:54.751920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:54.759049 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-831a28de-3bdb-483e-b64d-a78c8245e82d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.157526 Nov 22 16:53:54.759608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 414/839] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:54 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:55.101921 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:55.102500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:55.109854 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:55.110302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:55.111121 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:55.111556 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:55.137368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:53:55.226576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f9f9e913-6450-4c2f-ae63-095717174a6f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 204 len: 0 microversion: 2.1 time: 0.127536 Nov 22 16:53:55.228525 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 426/840] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:53:55 2021] DELETE /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:53:55.237340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:55.237961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:55.243951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:55.244433 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:55.245220 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:55.245659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:55.382034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:55.390892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-eb5ac1d4-0b1d-4e1b-b6da-d12de24da53c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1577 microversion: 2.1 time: 0.157188 Nov 22 16:53:55.391469 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 415/841] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:55 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:55.776203 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:55.776893 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:55.782887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:55.783337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:55.784135 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:55.784685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:55.921888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:55.929218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6e25a6d3-648a-4966-bfb4-737f9a4ae063 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.157077 Nov 22 16:53:55.929783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 427/842] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:55 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:56.408367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:56.408905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:56.415276 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:56.415727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:56.416590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:56.417027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:56.569902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:56.578556 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2efb146b-9b97-4afa-8de3-fbac8330837b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1577 microversion: 2.1 time: 0.173936 Nov 22 16:53:56.579154 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 416/843] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:56 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:53:56.946558 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:56.947314 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:56.955694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:56.956170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:56.956952 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:56.957415 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:57.099789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:57.107609 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-de13da17-29ae-497f-bdb9-f1bdd6ff7c35 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.164622 Nov 22 16:53:57.108218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 428/844] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:56 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:57.595970 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:57.596576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:57.602824 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:57.603269 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:57.604070 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:57.604594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:57.673693 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:57.682478 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6b8942ca-3456-4bf2-bca2-da05adf73ada tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1509 microversion: 2.1 time: 0.090175 Nov 22 16:53:57.683070 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 417/845] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:57 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1509 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:57.808402 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-d406120e-b960-42e0-afda-49260dee4dc3 req-f05fa2c0-8e7b-4c37-800e-62dd5219b54f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517240b-6ef9-466c-88ac-6e73bd2f771c", "name": "network-vif-plugged", "status": "completed", "tag": "8fb0874e-fcbc-4cce-87ba-7923e791f22c"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:53:57.811169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:53:57.811169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:53:57.824288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d406120e-b960-42e0-afda-49260dee4dc3 req-f05fa2c0-8e7b-4c37-800e-62dd5219b54f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:57.824288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d406120e-b960-42e0-afda-49260dee4dc3 req-f05fa2c0-8e7b-4c37-800e-62dd5219b54f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:57.847682 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-d406120e-b960-42e0-afda-49260dee4dc3 req-f05fa2c0-8e7b-4c37-800e-62dd5219b54f service nova] Creating event network-vif-plugged:8fb0874e-fcbc-4cce-87ba-7923e791f22c for instance 6517240b-6ef9-466c-88ac-6e73bd2f771c on hv-cinder-80473 Nov 22 16:53:57.853022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-d406120e-b960-42e0-afda-49260dee4dc3 req-f05fa2c0-8e7b-4c37-800e-62dd5219b54f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050016 Nov 22 16:53:57.853928 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 429/846] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:53:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:53:57.875044 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-f1b63d09-aa16-407c-86c1-4514c1fab94a req-3a03226c-e409-4d88-9ba4-c87c3e436047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4565565d-eecf-4bc1-8f80-5b7098b1ee3c", "name": "network-vif-deleted", "tag": "b43cbd76-1406-4b6b-bd9d-fbd30b43b398"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:53:57.876747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:53:57.876747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:53:57.902309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-f1b63d09-aa16-407c-86c1-4514c1fab94a req-3a03226c-e409-4d88-9ba4-c87c3e436047 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:57.902757 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-f1b63d09-aa16-407c-86c1-4514c1fab94a req-3a03226c-e409-4d88-9ba4-c87c3e436047 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:57.922598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-f1b63d09-aa16-407c-86c1-4514c1fab94a req-3a03226c-e409-4d88-9ba4-c87c3e436047 service nova] Creating event network-vif-deleted:b43cbd76-1406-4b6b-bd9d-fbd30b43b398 for instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c on hv-cinder-80473 Nov 22 16:53:57.929272 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-f1b63d09-aa16-407c-86c1-4514c1fab94a req-3a03226c-e409-4d88-9ba4-c87c3e436047 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058476 Nov 22 16:53:57.930765 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 418/847] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:53:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:53:58.128752 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:58.129551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:58.136202 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:58.137257 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:58.138557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:58.139106 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:58.302299 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:58.310169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9832c875-53b5-4b88-815c-ae6cd11a23b4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.185805 Nov 22 16:53:58.311226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 430/848] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:58 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:58.702351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:58.703164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:58.709502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:58.710036 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:58.710889 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:58.711398 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:58.745943 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:58.746310 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:58.747285 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lazy-loading 'fault' on Instance uuid 4565565d-eecf-4bc1-8f80-5b7098b1ee3c {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:53:58.787762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:58.796840 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c8814196-f614-4359-818d-f19fd8746d50 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 200 len: 1229 microversion: 2.1 time: 0.099651 Nov 22 16:53:58.797426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 419/849] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:58 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:59.327155 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:59.327869 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:59.334971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:59.335424 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:59.336252 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:59.336689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:59.477142 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:53:59.485266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-18ccc63b-6789-4ee9-92dd-219597ee2e40 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1362 microversion: 2.1 time: 0.162261 Nov 22 16:53:59.485897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 431/850] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:59 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:53:59.813311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:53:59.813957 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:53:59.823308 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:59.823791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:59.824623 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:53:59.825646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:53:59.839176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] HTTP exception thrown: Instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c could not be found. Nov 22 16:53:59.840062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Returning 404 to user: Instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:53:59.840916 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-783a8f4a-85d5-4aca-90d7-9cab2db3b564 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 404 len: 111 microversion: 2.1 time: 0.031816 Nov 22 16:53:59.841594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 420/851] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:53:59 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:53:59.944772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-490172371", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1382229380", "security_groups": [{"name": "tempest-secgroup-smoke-1121951638"}], "block_device_mapping_v2": [{"uuid": "b2696efe-7158-4516-aa09-9102f121d0ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b1c2e1e-d8e0-430c-9638-c1f4446f26b2"}]}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:00.057271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.network.neutron [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] validate_networks() for [('0b1c2e1e-d8e0-430c-9638-c1f4446f26b2', None, None, None, None, None)] {{(pid=133215) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:54:00.425283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Flavor limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:54:00.425794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Image limits 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:54:00.426170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Flavor pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:54:00.426588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Image pref 0:0:0 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:54:00.426997 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.virt.hardware [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:54:00.436827 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:00.437287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:00.438482 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:00.438926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:00.455290 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for project dd6bb6026ac74775904d68f7483c79c8. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:54:00.459279 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for user 431675338a834fcda7bc05e51ac001a1 and project dd6bb6026ac74775904d68f7483c79c8. Resources: {'ram', 'cores', 'instances'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:54:00.502149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:00.502866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:00.508736 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:00.509204 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:00.510027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:00.510490 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:00.515616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Going to run 1 instances... {{(pid=133215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:54:00.517852 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b2696efe-7158-4516-aa09-9102f121d0ad',volume_size=None,volume_type=None)] {{(pid=133215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:54:00.651258 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-77986944-aeba-47cc-92a9-a289b2fa1f22 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710322 Nov 22 16:54:00.651947 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 432/852] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:53:59 2021] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:54:00.655134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:00.666051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-388edb19-3e0f-46ed-9a34-49185cd6665f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:00.666051 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-388edb19-3e0f-46ed-9a34-49185cd6665f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:00.666373 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9dded25a-caa9-4438-b9b2-bc84ca22d689 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1548 microversion: 2.1 time: 0.164530 Nov 22 16:54:00.668680 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 421/853] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:00 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:00.680486 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:00.680982 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:00.688083 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:00.688726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:00.689680 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:00.690282 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:00.728456 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-388edb19-3e0f-46ed-9a34-49185cd6665f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:00.735553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-388edb19-3e0f-46ed-9a34-49185cd6665f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1094 microversion: 2.1 time: 0.076982 Nov 22 16:54:00.736171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 433/854] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:00 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:00.781093 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-211b7784-16d2-4304-9dae-35ad29ae0d0e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104167 Nov 22 16:54:00.781756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 422/855] 10.222.0.61 () {58 vars in 1274 bytes} [Mon Nov 22 16:54:00 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:54:01.752517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:01.753224 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:01.759872 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:01.760578 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:01.761475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:01.761965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:01.866794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:01.874905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9ff584b5-7255-4c71-b545-977ea90b8c75 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1210 microversion: 2.1 time: 0.125926 Nov 22 16:54:01.875587 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 434/856] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:01 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:02.035004 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:02.036091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:02.043191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:02.044336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:02.045167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:02.045569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:02.094750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-ba7ddac6-17ff-4669-917c-ad81025116f3 req-fba4a952-d559-4ae3-9bb2-2e996553ec8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6517240b-6ef9-466c-88ac-6e73bd2f771c", "tag": "8fb0874e-fcbc-4cce-87ba-7923e791f22c"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:02.097352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:54:02.097352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:54:02.104589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-ba7ddac6-17ff-4669-917c-ad81025116f3 req-fba4a952-d559-4ae3-9bb2-2e996553ec8b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:02.105030 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-ba7ddac6-17ff-4669-917c-ad81025116f3 req-fba4a952-d559-4ae3-9bb2-2e996553ec8b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:02.117132 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-ba7ddac6-17ff-4669-917c-ad81025116f3 req-fba4a952-d559-4ae3-9bb2-2e996553ec8b service nova] Creating event network-changed:8fb0874e-fcbc-4cce-87ba-7923e791f22c for instance 6517240b-6ef9-466c-88ac-6e73bd2f771c on hv-cinder-80473 Nov 22 16:54:02.122461 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-ba7ddac6-17ff-4669-917c-ad81025116f3 req-fba4a952-d559-4ae3-9bb2-2e996553ec8b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089081 Nov 22 16:54:02.123644 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 435/857] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:54:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:54:02.179619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d07f328a-9c8f-4cc8-865b-94154f286ca1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.148895 Nov 22 16:54:02.181115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 423/858] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:02 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:54:02.893899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:02.895703 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:02.904756 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:02.905178 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:02.905979 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:02.906406 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:03.104950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:03.115901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8a9627c5-e12b-470b-a3e8-ea9989d3d748 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.226336 Nov 22 16:54:03.124643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 436/859] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:02 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:03.204565 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:03.213417 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:03.230596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:03.231679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:03.233882 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:03.234575 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:03.331027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f9eeb60a-e0b7-4893-aca4-f4736f82683c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.141900 Nov 22 16:54:03.332400 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 424/860] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:03 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:54:03.799205 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-7ae4959a-e609-483c-a2a7-b18c1c6df0ad req-e14884e5-fe8e-4d75-9f4d-4fb2a3ea4b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24575018-194c-419c-8c58-1f7c89a4b192", "tag": "10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:03.801278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:54:03.801278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:54:03.812385 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-7ae4959a-e609-483c-a2a7-b18c1c6df0ad req-e14884e5-fe8e-4d75-9f4d-4fb2a3ea4b72 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:03.812835 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-7ae4959a-e609-483c-a2a7-b18c1c6df0ad req-e14884e5-fe8e-4d75-9f4d-4fb2a3ea4b72 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:03.828118 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-7ae4959a-e609-483c-a2a7-b18c1c6df0ad req-e14884e5-fe8e-4d75-9f4d-4fb2a3ea4b72 service nova] Creating event network-changed:10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7 for instance 24575018-194c-419c-8c58-1f7c89a4b192 on hv-cinder-80473 Nov 22 16:54:03.833887 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-7ae4959a-e609-483c-a2a7-b18c1c6df0ad req-e14884e5-fe8e-4d75-9f4d-4fb2a3ea4b72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040743 Nov 22 16:54:03.834494 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 437/861] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:54:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:54:04.134973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:04.135674 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:04.142711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:04.143162 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:04.143983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:04.144421 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:04.304526 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:04.314051 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b6e97e49-d54f-4d67-91b7-71b08a6bb00a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.183124 Nov 22 16:54:04.314737 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 425/862] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:04 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:04.346515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:04.347497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:04.353579 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:04.354021 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:04.354790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:04.355216 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:04.448553 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1354e2d1-41e2-421c-8ecd-9462eed3f3a7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.106295 Nov 22 16:54:04.452221 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 438/863] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:04 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:54:05.330076 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:05.330690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:05.336951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:05.337395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:05.338184 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:05.338611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:05.460428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:05.461470 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:05.469504 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:05.469846 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:05.470755 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:05.471197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:05.473960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:05.481568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-60cdf111-5bfc-4c1b-ac34-5deb788be7bd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.155205 Nov 22 16:54:05.482134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 426/864] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:05 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:05.552352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-206627eb-4c8a-41c1-aaa1-3f35ab239afd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.095527 Nov 22 16:54:05.552896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 439/865] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:05 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 16:54:06.498349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:06.498988 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:06.505891 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:06.506340 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:06.507121 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:06.507585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:06.563688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:06.564863 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:06.571740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:06.572280 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:06.573129 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:06.573633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:06.640938 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:06.648134 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-eba5bac3-5944-477b-9a62-79d4c847a8e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.153445 Nov 22 16:54:06.648694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 427/866] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:06 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:06.660241 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a6c3be3b-6958-4867-82bc-63a825fc32c9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.101044 Nov 22 16:54:06.660897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 440/867] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:06 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 16:54:07.664886 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:07.665514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:07.670713 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:07.671731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:07.671919 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:07.672374 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:07.673156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:07.673591 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:07.678344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:07.678791 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:07.679571 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:07.680028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:07.759749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-aeb7712d-1e04-4c98-b097-3d60dff239ca tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.092146 Nov 22 16:54:07.759895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 441/868] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:07 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 16:54:07.812872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:07.820241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f801112e-8fa2-4a61-ba33-bf04d0bdb531 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.159139 Nov 22 16:54:07.820806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 428/869] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:07 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:08.770265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:08.771248 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:08.778143 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:08.778589 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:08.779353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:08.779783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:08.837980 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:08.838596 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:08.845517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:08.845972 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:08.846767 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:08.847207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:08.859733 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-299fb678-7493-432f-a7bd-94592e3b0ebc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.093471 Nov 22 16:54:08.860419 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 442/870] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:08 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:54:08.977507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:08.985543 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ea6ffa5f-09b4-4f2e-9100-dae269f25555 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.151083 Nov 22 16:54:08.985987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 429/871] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:08 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:09.871195 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:09.872239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:09.879425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:09.879907 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:09.880694 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:09.881132 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:09.962915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-872627f4-cb57-43e6-8bd6-e7fb701056e3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.095519 Nov 22 16:54:09.963864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 443/872] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:09 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:54:10.002696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:10.003310 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:10.009878 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:10.010425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:10.011232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:10.011661 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:10.144789 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:10.152078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-be0b4606-31bb-4fe3-b6d0-2260e21b34a0 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.153627 Nov 22 16:54:10.152646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 430/873] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:09 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:10.974678 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:10.975677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:10.982763 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:10.983213 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:10.984034 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:10.984857 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:11.069983 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b70c77df-8bf6-472a-8787-8e8c779e3810 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 14 microversion: 2.1 time: 0.099201 Nov 22 16:54:11.070634 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 444/874] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:10 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:54:11.168273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:11.168902 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:11.176361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:11.176821 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:11.177608 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:11.178046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:11.311310 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:11.319351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1fcce688-969c-4e56-9a19-8182e806e5d4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.154737 Nov 22 16:54:11.319928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 431/875] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:11 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:12.081930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:12.082930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:12.089967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:12.090409 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:12.091181 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:12.091613 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:12.182414 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-80da6c59-8f88-4cd0-8b0c-c4121c0de9d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 11817 microversion: 2.1 time: 0.104840 Nov 22 16:54:12.183044 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 445/876] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:12 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 11817 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:12.336465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:12.336980 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:12.343333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:12.343785 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:12.344576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:12.345518 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:12.489800 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:12.497588 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1a66fdc9-91e6-41f1-a8c3-33e3e65c44ec tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.164851 Nov 22 16:54:12.498167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 432/877] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:12 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:13.195115 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:13.196207 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:13.203398 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:13.203806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:13.204637 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:13.205099 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:13.295593 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d1841632-ebdd-4fe0-8223-f1b7da273872 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 18498 microversion: 2.1 time: 0.105373 Nov 22 16:54:13.296297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 446/878] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:13 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 18498 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:13.514459 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:13.515079 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:13.521450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:13.521887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:13.522669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:13.523107 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:13.666006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:13.673425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-63658779-92ff-49bc-b441-8a698a1bb549 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.162800 Nov 22 16:54:13.673989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 433/879] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:13 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:14.308241 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:14.309247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:14.316347 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:14.316806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:14.317599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:14.318042 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:14.404639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5c101726-6344-41e1-828f-a1d791615f32 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 19342 microversion: 2.1 time: 0.100316 Nov 22 16:54:14.408306 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 447/880] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:14 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 19342 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:14.691892 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:14.692504 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:14.698899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:14.699342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:14.700160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:14.700595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:14.834430 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:14.841814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-eda21881-f17d-449c-84da-9345e9881a2c tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.154450 Nov 22 16:54:14.842375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 434/881] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:14 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:15.416754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:15.417656 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:15.425638 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:15.426124 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:15.426913 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:15.427351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:15.517478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6f7107f2-3ddc-4397-9657-0c5e9924a6d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 21935 microversion: 2.1 time: 0.104797 Nov 22 16:54:15.518849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 448/882] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:15 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 21935 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:15.846149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-960f1990-d430-4087-88db-b766bf0a900d req-fb2bf01d-a7bb-4b98-9516-fd8193b9607c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24575018-194c-419c-8c58-1f7c89a4b192", "name": "network-vif-plugged", "status": "completed", "tag": "10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:15.848351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:54:15.848351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:54:15.855770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-960f1990-d430-4087-88db-b766bf0a900d req-fb2bf01d-a7bb-4b98-9516-fd8193b9607c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:15.856231 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-960f1990-d430-4087-88db-b766bf0a900d req-fb2bf01d-a7bb-4b98-9516-fd8193b9607c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:15.860189 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:15.861173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:15.868520 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:15.869068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:15.869214 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-960f1990-d430-4087-88db-b766bf0a900d req-fb2bf01d-a7bb-4b98-9516-fd8193b9607c service nova] Creating event network-vif-plugged:10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7 for instance 24575018-194c-419c-8c58-1f7c89a4b192 on hv-cinder-80473 Nov 22 16:54:15.869989 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:15.870528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:15.874086 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-960f1990-d430-4087-88db-b766bf0a900d req-fb2bf01d-a7bb-4b98-9516-fd8193b9607c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Nov 22 16:54:15.874680 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 435/883] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:54:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:54:16.014500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:16.022950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7996f144-d9db-4459-819d-09f4f9375754 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.167329 Nov 22 16:54:16.023751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 449/884] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:15 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:16.531408 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:16.532472 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:16.539729 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:16.540219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:16.541020 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:16.541464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:16.640543 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-fd776f60-d14c-44f6-bb31-e5fe9003ec0a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 23232 microversion: 2.1 time: 0.113160 Nov 22 16:54:16.641615 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 436/885] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:16 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 23232 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:17.040404 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:17.041080 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:17.047392 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:17.047901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:17.048910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:17.049472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:17.186486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:17.194043 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-50a5617d-1633-4e74-844f-860534ee00dd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1266 microversion: 2.1 time: 0.157251 Nov 22 16:54:17.194627 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 450/886] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:17 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:17.653143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:17.654148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:17.660984 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:17.661435 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:17.662208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:17.662646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:17.757366 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7a8536e7-1c6c-4507-ba0d-75836434924d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 24403 microversion: 2.1 time: 0.107959 Nov 22 16:54:17.757931 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 437/887] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:17 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 24403 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:18.210713 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:18.211449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:18.217981 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:18.218422 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:18.219225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:18.219651 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:18.354244 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:18.362669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6bae3f87-0c55-4575-970e-208a4882aa90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1453 microversion: 2.1 time: 0.154837 Nov 22 16:54:18.363240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 451/888] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:18 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:18.379031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:18.379776 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:18.386881 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:18.387333 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:18.388151 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:18.388622 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:18.530387 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:18.538815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a4b85a50-d641-4ad6-b065-7e4cad5eaa5f tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1453 microversion: 2.1 time: 0.163872 Nov 22 16:54:18.539367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 438/889] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:18 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:18.769672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:18.770711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:18.777094 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:18.777548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:18.778334 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:18.778804 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:18.868586 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b760683e-ae31-4129-bf79-39e12d263d6d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 26039 microversion: 2.1 time: 0.103079 Nov 22 16:54:18.870074 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 452/890] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:18 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 26039 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:19.811996 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:19.812679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:19.819396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:19.819867 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:19.820662 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:19.821098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:19.843582 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lazy-loading 'flavor' on Instance uuid 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:54:19.881969 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:19.883953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:19.892136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:19.892954 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:19.894571 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:19.895264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:19.935059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b6055c77-9166-4ff5-b9f5-3bec478cd846 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "POST /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c/action" status: 202 len: 0 microversion: 2.1 time: 0.126539 Nov 22 16:54:19.935678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 439/891] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:19 2021] POST /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:54:19.944718 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:19.945425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:19.952386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:19.952839 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:19.953646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:19.954085 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:20.008466 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d8f3222d-6f59-4ab6-bf2d-441fbff77dd0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 27299 microversion: 2.1 time: 0.130853 Nov 22 16:54:20.009290 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 453/892] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:19 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 27299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:54:20.286315 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:20.293819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f1d1e7f1-e62c-44f6-a844-cb61954f539c tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.353585 Nov 22 16:54:20.294385 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 440/893] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:19 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:20.516341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-d904e0f4-2229-4763-9681-c6538886bb8b req-5bef1cac-4519-4ddf-96ba-43536742c63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24575018-194c-419c-8c58-1f7c89a4b192", "tag": "10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:20.517991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:54:20.517991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:54:20.526862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d904e0f4-2229-4763-9681-c6538886bb8b req-5bef1cac-4519-4ddf-96ba-43536742c63f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:20.527426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d904e0f4-2229-4763-9681-c6538886bb8b req-5bef1cac-4519-4ddf-96ba-43536742c63f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:20.539548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-d904e0f4-2229-4763-9681-c6538886bb8b req-5bef1cac-4519-4ddf-96ba-43536742c63f service nova] Creating event network-changed:10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7 for instance 24575018-194c-419c-8c58-1f7c89a4b192 on hv-cinder-80473 Nov 22 16:54:20.544754 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-d904e0f4-2229-4763-9681-c6538886bb8b req-5bef1cac-4519-4ddf-96ba-43536742c63f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032358 Nov 22 16:54:20.545388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 454/894] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:54:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:54:21.020921 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:21.021888 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:21.028235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:21.028685 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:21.029475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:21.030090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:21.131705 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2ddf31a8-0eb0-420e-968f-71ad3dc642f4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 27734 microversion: 2.1 time: 0.114695 Nov 22 16:54:21.136167 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 441/895] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:21 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 27734 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:21.313004 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:21.313749 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:21.320168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:21.320626 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:21.321530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:21.321850 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:21.470633 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:21.479849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6f6de853-f0f3-4b55-974b-0f2cb84c7e93 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.171223 Nov 22 16:54:21.480438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 455/896] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:21 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:22.145387 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:22.146387 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:22.153502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:22.153953 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:22.154767 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:22.155211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:22.254093 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-68d9ad28-e698-458e-84c1-589335946e0c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28163 microversion: 2.1 time: 0.113461 Nov 22 16:54:22.254698 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 442/897] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:22 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28163 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:22.497428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:22.498011 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:22.505120 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:22.505509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:22.506282 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:22.506709 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:22.645063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:22.652715 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-54c23ce2-1c9f-42bd-93f2-095ca51a4928 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.158919 Nov 22 16:54:22.653283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 456/898] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:22 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:23.266361 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:23.267364 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:23.275164 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:23.275609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:23.276437 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:23.276869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:23.369532 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-167664e5-9854-4ef9-a2d2-ac3830b03387 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28163 microversion: 2.1 time: 0.107146 Nov 22 16:54:23.370185 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 443/899] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:23 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28163 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:23.670357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:23.670948 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:23.677478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:23.677916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:23.678688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:23.679116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:23.822564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:23.831344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b972702c-2f18-438c-ae4e-54629f835fbc tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.164463 Nov 22 16:54:23.831948 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 457/900] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:23 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:24.381964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:24.382962 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:24.391587 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:24.392081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:24.392881 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:24.393951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:24.489558 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8d2bd6ef-544e-4673-87e9-1330b38d414e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28454 microversion: 2.1 time: 0.112007 Nov 22 16:54:24.490128 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 444/901] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:24 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:54:24.849162 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:24.849774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:24.856408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:24.856847 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:24.857634 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:24.858057 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:24.997925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:25.006020 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-75e93e39-2faa-4884-8798-3409d3984541 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.160633 Nov 22 16:54:25.006598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 458/902] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:24 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:25.501847 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:25.502915 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:25.510078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:25.510529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:25.511314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:25.511742 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:25.616273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b685a7e1-23cf-4897-b957-9b1bec957ff8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28622 microversion: 2.1 time: 0.118251 Nov 22 16:54:25.616925 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 445/903] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:25 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28622 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:26.023717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:26.024342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:26.030714 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:26.031158 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:26.031977 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:26.032433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:26.167882 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:26.176166 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6f16b3a6-d77c-495d-8193-647dceff64e3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.156262 Nov 22 16:54:26.176740 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 459/904] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:26 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:26.628992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:26.630005 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:26.637198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:26.637650 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:26.638453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:26.638889 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:26.740107 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1fb9fb9f-646f-407d-a594-8fe6967602d0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28622 microversion: 2.1 time: 0.115279 Nov 22 16:54:26.741003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 446/905] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:26 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28622 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:27.194792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:27.195460 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:27.201765 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:27.202147 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:27.202916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:27.203344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:27.344206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:27.352256 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7b70af92-1dcb-43b3-98e2-aa1b63046559 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.161080 Nov 22 16:54:27.352830 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 460/906] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:27 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:27.751741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:27.753493 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:27.760287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:27.760736 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:27.761511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:27.761942 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:27.853672 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ee262743-1b5e-4699-834a-8bb81f7a6cd4 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28622 microversion: 2.1 time: 0.105642 Nov 22 16:54:27.854337 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 447/907] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:27 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28622 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:28.369534 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:28.370150 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:28.376465 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:28.376914 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:28.378620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:28.379131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:28.515997 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:28.523676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-58e0d4bf-931b-48c9-8fb8-4b40c9bf5567 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.157868 Nov 22 16:54:28.524278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 461/908] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:28 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:28.868042 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:28.869033 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:28.875873 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:28.876324 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:28.877097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:28.877754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:28.970869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-57c99f0e-9ecc-449c-bd69-6d625c350c49 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 28959 microversion: 2.1 time: 0.106812 Nov 22 16:54:28.972330 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 448/909] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:28 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 28959 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:29.540772 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:29.541382 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:29.547743 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:29.548228 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:29.549008 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:29.549562 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:29.686511 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:29.694968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-86d1f34d-431b-48f6-996b-cb563bb159ab tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.157883 Nov 22 16:54:29.695541 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 462/910] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:29 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:29.983196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:29.984071 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:29.992046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:29.992501 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:29.993275 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:29.993708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:30.091712 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9ed6d6f4-0cb0-4681-9ec6-3c08ed240b95 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 31057 microversion: 2.1 time: 0.112473 Nov 22 16:54:30.092552 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 449/911] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:29 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 31057 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:30.712578 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:30.713129 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:30.719985 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:30.720443 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:30.721825 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:30.722263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:30.864919 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:30.872490 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-418d0d46-4c79-4859-ba0a-69545ac63c3d tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.163784 Nov 22 16:54:30.873092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 463/912] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:30 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:31.103385 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:31.104420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:31.111219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:31.111804 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:31.112813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:31.113180 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:31.211348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3a65caba-399f-4f4f-8a59-639e983d28ea tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 32539 microversion: 2.1 time: 0.111760 Nov 22 16:54:31.212047 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 450/913] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:31 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 32539 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:31.890264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:31.890802 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:31.897874 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:31.898355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:31.899093 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:31.899521 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:32.040751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:32.048157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ca3a0029-a4ac-450a-9100-250c2b000f2f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.161527 Nov 22 16:54:32.048725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 464/914] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:31 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:32.225514 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:32.226534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:32.233427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:32.233954 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:32.234896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:32.235296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:32.370341 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a354bc99-38c8-474e-847b-c3bfb1c22c7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 33490 microversion: 2.1 time: 0.149767 Nov 22 16:54:32.370998 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 451/915] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:32 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 33490 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:54:33.068170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:33.069017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:33.076344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.076789 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.077624 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.078056 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.238932 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:33.247751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fa2c8408-5d48-4ed8-80f3-f68f765a69ce tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1567 microversion: 2.1 time: 0.184796 Nov 22 16:54:33.248387 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 465/916] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:33 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:33.266604 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:33.267257 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:33.275432 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.276326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.276874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.277325 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.366207 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-94f9433c-4c99-4d30-8da8-1030056392e7 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "POST /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c/action" status: 202 len: 0 microversion: 2.1 time: 0.103873 Nov 22 16:54:33.366808 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 452/917] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:33 2021] POST /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:54:33.376348 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:33.378199 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:33.383746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:33.383994 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.384231 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.384691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:33.385002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.385436 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.390699 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.391146 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.392006 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:33.392484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:33.499611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-50e92c5a-80a6-456c-9679-aa4a6a9566d2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 34361 microversion: 2.1 time: 0.118968 Nov 22 16:54:33.501081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 453/918] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:33 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 34361 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:54:33.535217 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:33.543527 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-6028273e-3d2e-4cdc-9334-6c1901b3016a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1575 microversion: 2.1 time: 0.170857 Nov 22 16:54:33.544364 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 466/919] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:33 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:34.512910 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:34.513930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:34.521762 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:34.522220 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:34.523021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:34.523508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:34.562294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:34.562896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:34.569985 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:34.570438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:34.571224 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:34.571660 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:34.629413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8d77ccec-8aae-498d-aec9-e3a08df21342 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 35346 microversion: 2.1 time: 0.120937 Nov 22 16:54:34.631975 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 454/920] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:34 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 35346 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:34.713096 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:34.720836 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3367d110-793d-4fca-87e9-cd27be2eb9ba tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1517 microversion: 2.1 time: 0.162210 Nov 22 16:54:34.721485 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 467/921] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:34 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:35.641884 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:35.642950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:35.650810 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:35.650810 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:35.651115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:35.651546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:35.738286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:35.739529 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:35.745734 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:35.746182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:35.746949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:35.747375 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:35.759467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-702f1bd8-7d93-4b40-8c46-e7ad4e332992 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 36790 microversion: 2.1 time: 0.121378 Nov 22 16:54:35.762059 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 455/922] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:35 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 36790 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:35.880169 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:35.889487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5f6d3110-9c5c-47aa-9292-0b1f4adbfcca tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.154803 Nov 22 16:54:35.890048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 468/923] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:35 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:36.771034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:36.772098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:36.779230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:36.779688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:36.780538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:36.780960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:36.872952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1b46bba9-5386-4e4c-822c-d177d4605945 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 37987 microversion: 2.1 time: 0.105784 Nov 22 16:54:36.873617 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 456/924] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:36 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 37987 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:36.907351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:36.907990 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:36.915186 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:36.915640 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:36.916442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:36.916871 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:37.046240 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:37.054602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-30457816-daf9-48e5-a7c4-85a5c924fd80 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.151016 Nov 22 16:54:37.055174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 469/925] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:36 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:37.867356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-02498fc5-b63e-4382-ab9c-6e80bc79d5f1 req-08f4f4eb-e35f-438a-8a4f-fd500f2d0abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "name": "network-vif-unplugged", "status": "completed", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:37.869017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:54:37.869017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:54:37.876846 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-02498fc5-b63e-4382-ab9c-6e80bc79d5f1 req-08f4f4eb-e35f-438a-8a4f-fd500f2d0abc service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:37.877961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-02498fc5-b63e-4382-ab9c-6e80bc79d5f1 req-08f4f4eb-e35f-438a-8a4f-fd500f2d0abc service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:37.884429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:37.885712 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:37.892142 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:37.892472 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-02498fc5-b63e-4382-ab9c-6e80bc79d5f1 req-08f4f4eb-e35f-438a-8a4f-fd500f2d0abc service nova] Creating event network-vif-unplugged:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:54:37.893388 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:37.894442 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:37.894950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:37.898251 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-02498fc5-b63e-4382-ab9c-6e80bc79d5f1 req-08f4f4eb-e35f-438a-8a4f-fd500f2d0abc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035374 Nov 22 16:54:37.899327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 457/926] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:54:37 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:54:38.004145 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5c15c4d0-693d-4501-8d72-9ff44a011292 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 38146 microversion: 2.1 time: 0.123630 Nov 22 16:54:38.004792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 470/927] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:37 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 38146 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:54:38.072515 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:38.073148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:38.079168 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:38.079612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:38.080464 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:38.080977 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:38.215814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:38.224127 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-70c778d2-58b4-479b-9798-84c0f774b70f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.156070 Nov 22 16:54:38.224692 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 458/928] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:38 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:39.017178 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:39.018199 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:39.025066 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:39.025510 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:39.026281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:39.026742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:39.116062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-14856439-1028-44aa-8903-450decec0140 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 38146 microversion: 2.1 time: 0.102689 Nov 22 16:54:39.116731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 471/929] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:39 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 38146 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:39.241045 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:39.241565 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:39.247739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:39.248218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:39.248993 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:39.249427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:39.380773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:39.388652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ec82de7c-4bd8-475f-8990-d7ef2b5d1e13 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.151999 Nov 22 16:54:39.389229 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 459/930] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:39 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:40.128810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:40.129830 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:40.137041 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:40.137496 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:40.138289 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:40.138719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:40.227204 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-435f9859-1837-41dd-96f2-da806b35e273 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 38146 microversion: 2.1 time: 0.102134 Nov 22 16:54:40.227762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 472/931] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:40 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 38146 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:40.405659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:40.406271 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:40.413401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:40.413855 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:40.414642 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:40.415077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:40.550561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:40.557856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b92593a4-6de4-4c2c-9033-3023fc29ab4a tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.155863 Nov 22 16:54:40.558419 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 460/932] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:40 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:41.241483 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:41.242545 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:41.251247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:41.251700 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:41.252517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:41.254161 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:41.344500 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-bcb12499-934b-4b32-b2a4-2333825b7a04 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 200 len: 38273 microversion: 2.1 time: 0.108543 Nov 22 16:54:41.345163 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 473/933] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:41 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 38273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:54:41.355677 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:41.356197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:41.363039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:41.363483 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:41.364322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:41.364738 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:41.386980 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-01551438-672b-4bd7-bf0c-9a1ef5a6bfa5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/ips" status: 200 len: 145 microversion: 2.1 time: 0.035021 Nov 22 16:54:41.387533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 461/934] 10.222.0.61 () {58 vars in 1247 bytes} [Mon Nov 22 16:54:41 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:54:41.576478 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:41.577170 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:41.585198 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:41.585647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:41.586429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:41.586896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:41.719425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:41.727367 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-798675c0-a52d-415c-b4f1-4f1f88843fdf tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.154886 Nov 22 16:54:41.727955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 474/935] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:41 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:42.744329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:42.744946 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:42.751162 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:42.751641 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:42.752461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:42.752959 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:42.886390 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:42.894331 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b2a3e007-35ae-4b6d-a0db-21e8640db08f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1573 microversion: 2.1 time: 0.153035 Nov 22 16:54:42.894883 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 462/936] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:42 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:43.739341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "757f10f2-870f-4d87-917d-d6233395dfd3"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:43.740428 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:43.746851 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:43.747298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:43.748110 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:43.748548 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:43.912033 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:43.913313 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:43.925856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:43.926324 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:43.927117 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:43.927546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:44.049652 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-06252653-97e9-4a7c-937a-3435b11ef8a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.314683 Nov 22 16:54:44.050615 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 475/937] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:54:43 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:54:44.092574 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:44.101302 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-58bd711d-c565-4081-bf4a-1a4e1d82a6a9 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1560 microversion: 2.1 time: 0.194322 Nov 22 16:54:44.101439 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 463/938] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:43 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:54:45.943905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-f2875596-2298-4cfa-a867-614583bdb568 req-a76d2341-0f38-4e1e-b738-61a3dfe849cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "name": "network-vif-plugged", "status": "completed", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:45.949406 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:54:45.949406 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:54:45.957975 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-f2875596-2298-4cfa-a867-614583bdb568 req-a76d2341-0f38-4e1e-b738-61a3dfe849cc service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:45.958431 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-f2875596-2298-4cfa-a867-614583bdb568 req-a76d2341-0f38-4e1e-b738-61a3dfe849cc service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:45.969702 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-f2875596-2298-4cfa-a867-614583bdb568 req-a76d2341-0f38-4e1e-b738-61a3dfe849cc service nova] Creating event network-vif-plugged:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:54:45.975610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-f2875596-2298-4cfa-a867-614583bdb568 req-a76d2341-0f38-4e1e-b738-61a3dfe849cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035985 Nov 22 16:54:45.976273 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 476/939] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:54:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:54:51.522154 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2d44d232-97a2-4ef4-987f-8575601387b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:54:51.528705 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d44d232-97a2-4ef4-987f-8575601387b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:51.529155 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2d44d232-97a2-4ef4-987f-8575601387b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:51.591382 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2d44d232-97a2-4ef4-987f-8575601387b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Going to try to stop instance {{(pid=133216) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 16:54:51.639003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2d44d232-97a2-4ef4-987f-8575601387b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 202 len: 0 microversion: 2.1 time: 0.120750 Nov 22 16:54:51.639774 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 464/940] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:54:51 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:54:51.650502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:51.652258 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:51.660955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:51.661723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:51.662746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:51.663284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:51.801867 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:51.810128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-286e55d4-d39b-4541-8cee-ca63446b436f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.164787 Nov 22 16:54:51.810720 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 477/941] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:51 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:52.828743 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:52.829433 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:52.836619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:52.837061 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:52.837845 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:52.838273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:52.979410 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:52.987797 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a277b1f7-75f4-4a8b-8cf1-517cbc6eeb02 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.162561 Nov 22 16:54:52.988624 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 465/942] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:52 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:54.006083 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:54.006689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:54.013079 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:54.013528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:54.014330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:54.014766 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:54.150064 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:54.158136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8217ec1b-5fa3-44ad-b9a4-428b44747644 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.156616 Nov 22 16:54:54.159220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 478/943] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:54 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:55.176467 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:55.177075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:55.183777 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:55.184285 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:55.185141 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:55.185620 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:55.330555 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:55.338779 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8e75ffbe-0062-48f0-8065-e1a310f1b835 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.166476 Nov 22 16:54:55.339365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 466/944] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:55 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:56.356804 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:56.357387 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:56.364201 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:56.364636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:56.365528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:56.365967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:56.501019 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:56.509691 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1c3b29a4-afe2-4c4f-ac70-2b180e62f482 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.156679 Nov 22 16:54:56.510270 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 479/945] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:56 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:57.528809 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:57.529429 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:57.535747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:57.536251 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:57.537024 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:57.537465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:57.668345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:57.676066 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a76ad00d-6b0c-4c77-bc49-b9465b382690 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.150860 Nov 22 16:54:57.676627 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 467/946] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:57 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:58.693780 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:58.694488 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:58.700819 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:58.701268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:58.702069 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:58.702530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:58.837986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:54:58.846048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-bc155c69-733f-4b22-9ac0-357e5bec8d3b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.156755 Nov 22 16:54:58.846628 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 480/947] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:58 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:54:59.863743 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:54:59.864319 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:54:59.870754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:59.871200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:54:59.872034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:54:59.872468 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:00.001660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:00.009415 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5a47a481-b0be-410c-b369-3ea04f341b1e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.149638 Nov 22 16:55:00.009976 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 468/948] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:54:59 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:01.026452 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:01.026978 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:01.033341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:01.034906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:01.035151 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:01.035587 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:01.168837 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:01.177115 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-dd8b9272-6277-4db0-a72c-5672d5c93408 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.154391 Nov 22 16:55:01.177679 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 481/949] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:01 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:02.194815 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:02.195426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:02.201930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:02.202335 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:02.203154 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:02.203594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:02.337063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:02.345108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ed1f798e-20bb-4128-8dfc-b0ecf7fc106b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.154027 Nov 22 16:55:02.345670 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 469/950] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:02 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:03.362409 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:03.362971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:03.369276 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:03.369728 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:03.370520 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:03.370959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:03.501091 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:03.509677 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-770966f1-a47a-4a26-81a1-5f8d6b454630 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.151115 Nov 22 16:55:03.510254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 482/951] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:03 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:04.526403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:04.527013 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:04.533258 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:04.534882 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:04.535669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:04.536140 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:04.667814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:04.676190 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ebc34645-ad42-4138-bda4-c5b35fd2a21a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.153335 Nov 22 16:55:04.676757 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 470/952] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:04 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:05.693127 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:05.693735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:05.700047 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:05.700491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:05.701255 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:05.701686 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:05.831187 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:05.839020 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-eb737612-a381-48a9-a8d7-dedf8344dc6f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.149571 Nov 22 16:55:05.839877 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 483/953] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:05 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:06.857055 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:06.857659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:06.864784 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:06.865236 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:06.866171 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:06.866447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:06.996897 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:07.004690 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4ad8d741-5839-4920-8a96-2d5262522b38 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1722 microversion: 2.1 time: 0.151268 Nov 22 16:55:07.005252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 471/954] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:06 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:08.021802 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:08.022405 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:08.028786 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:08.029227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:08.030002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:08.030429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:08.161324 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:08.169049 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5f310610-f553-4bf6-a402-f3c9d0de141b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1699 microversion: 2.1 time: 0.150868 Nov 22 16:55:08.169611 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 484/955] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:08 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1699 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:08.185814 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-467cbbd7-94c9-4a7b-9268-e2125d6ca3d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:55:08.192679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-467cbbd7-94c9-4a7b-9268-e2125d6ca3d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:08.193081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-467cbbd7-94c9-4a7b-9268-e2125d6ca3d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:08.214688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-467cbbd7-94c9-4a7b-9268-e2125d6ca3d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Going to try to start instance {{(pid=133216) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 16:55:08.255712 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-467cbbd7-94c9-4a7b-9268-e2125d6ca3d3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 202 len: 0 microversion: 2.1 time: 0.073469 Nov 22 16:55:08.256405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 472/956] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:55:08 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:55:08.264199 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:08.264920 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:08.271019 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:08.271463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:08.272268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:08.272710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:08.407536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:08.416003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ae1fa520-2f47-458b-b980-a04cf94d3204 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1708 microversion: 2.1 time: 0.155271 Nov 22 16:55:08.416577 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 485/957] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:08 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1708 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:09.435389 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:09.436149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:09.443180 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:09.443628 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:09.444425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:09.444862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:09.582441 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:09.590626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7723fc72-692b-4fca-a775-352353174f4d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1708 microversion: 2.1 time: 0.159732 Nov 22 16:55:09.591217 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 473/958] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:09 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1708 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:10.608278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:10.608895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:10.616381 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:10.616961 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:10.617910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:10.618433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:10.749918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:10.758254 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4cbeae6b-7a90-4c40-b23f-d25f0d7e8b54 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1712 microversion: 2.1 time: 0.153773 Nov 22 16:55:10.758817 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 486/959] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:10 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1712 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:43.926450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:43.927060 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:43.933254 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:43.933708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:43.934505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:43.934957 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:44.013037 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lazy-loading 'services' on Instance uuid 6517240b-6ef9-466c-88ac-6e73bd2f771c {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:55:44.084638 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-20734fc4-9d24-474f-9c4a-4a27e5a5e6fa tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-volume_attachments/757f10f2-870f-4d87-917d-d6233395dfd3" status: 202 len: 0 microversion: 2.1 time: 0.161867 Nov 22 16:55:44.085263 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 474/960] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:55:43 2021] DELETE /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-volume_attachments/757f10f2-870f-4d87-917d-d6233395dfd3 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:55:45.192425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9f74cc99-57eb-4884-8366-e03961f0d498 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:55:45.198516 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9f74cc99-57eb-4884-8366-e03961f0d498 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:45.198964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9f74cc99-57eb-4884-8366-e03961f0d498 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:45.259973 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9f74cc99-57eb-4884-8366-e03961f0d498 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Going to try to stop instance {{(pid=133215) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 16:55:45.307062 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9f74cc99-57eb-4884-8366-e03961f0d498 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 202 len: 0 microversion: 2.1 time: 0.118242 Nov 22 16:55:45.308373 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 487/961] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:55:45 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:55:45.318214 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:45.318914 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:45.325561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:45.326014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:45.326826 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:45.327481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:45.482965 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:45.490611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e97889fe-8207-4bb8-80c7-132e062ffa01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.177866 Nov 22 16:55:45.491198 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 475/962] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:45 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:55:46.508658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:46.509341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:46.516063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:46.516509 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:46.517853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:46.518347 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:46.653284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:46.660638 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f5f38bd5-7a49-42a0-8059-2418661f9b86 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.155953 Nov 22 16:55:46.661208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 488/963] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:46 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:47.678288 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:47.678894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:47.685700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:47.686148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:47.686928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:47.687371 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:47.823646 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:47.832445 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4948c69d-a107-4b85-bdd0-e80cca15f5e8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.157910 Nov 22 16:55:47.833025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 476/964] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:47 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:48.849964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:48.850556 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:48.856823 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:48.857277 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:48.858058 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:48.858494 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:48.996301 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:49.003944 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-60778d5c-510e-4923-bab7-974caa7d1d25 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.158149 Nov 22 16:55:49.004705 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 489/965] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:48 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:50.020964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:50.021990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:50.029052 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:50.029499 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:50.030291 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:50.030722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:50.163021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:50.170528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-afa7a7af-2e1e-4d9e-ae8b-c4dc0019d3bc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.153844 Nov 22 16:55:50.171099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 477/966] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:50 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:55:51.188193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:51.188774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:51.194783 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:51.195238 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:51.196056 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:51.196497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:51.329610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:51.338371 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-374e20ae-5228-4af4-b15b-ffab672a8a41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.153770 Nov 22 16:55:51.338968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 490/967] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:51 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:52.355874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:52.356426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:52.363903 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:52.364362 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:52.365145 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:52.365577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:52.497011 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:52.504971 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e07b5a4e-07fe-4ac2-8d34-19cb90dd7f87 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.152880 Nov 22 16:55:52.505547 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 478/968] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:52 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:53.522239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:53.522865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:53.529206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:53.529751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:53.530433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:53.530873 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:53.673180 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:53.681325 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-88a2a11d-431d-4139-a590-e7818051874b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.163242 Nov 22 16:55:53.681902 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 491/969] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:53 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:54.699025 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:54.699619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:54.705982 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:54.706930 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:54.707713 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:54.708171 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:54.847816 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:54.855479 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3a52b1c1-06f6-4cde-8463-2a562908f501 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1676 microversion: 2.1 time: 0.160033 Nov 22 16:55:54.856084 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 479/970] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:54 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:55.872532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:55.873070 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:55.879521 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:55.880093 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:55.880880 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:55.881310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:56.025197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:56.032635 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b738aaef-7205-418e-9546-1d0e4682aa2e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1653 microversion: 2.1 time: 0.163782 Nov 22 16:55:56.033206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 492/971] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:55 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1653 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:56.049120 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-66dafba1-a206-45df-b34b-7e93636d1c78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:55:56.055875 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-66dafba1-a206-45df-b34b-7e93636d1c78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:56.056329 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-66dafba1-a206-45df-b34b-7e93636d1c78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:56.078554 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-66dafba1-a206-45df-b34b-7e93636d1c78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Going to try to start instance {{(pid=133216) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 16:55:56.123079 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-66dafba1-a206-45df-b34b-7e93636d1c78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action" status: 202 len: 0 microversion: 2.1 time: 0.077259 Nov 22 16:55:56.123602 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 480/972] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:55:56 2021] POST /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:55:56.132311 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:56.132923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:56.138751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:56.139210 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:56.140092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:56.140579 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:56.278070 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:56.286996 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-3f1ba563-d79d-4f92-8024-53703c07291c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1662 microversion: 2.1 time: 0.158523 Nov 22 16:55:56.287597 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 493/973] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:56 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1662 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:55:57.305513 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:55:57.306149 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:55:57.312534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:57.312986 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:57.313790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:55:57.314250 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:55:57.457820 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:55:57.465976 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3544a116-144e-4690-8d93-a9dd51501686 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1666 microversion: 2.1 time: 0.165260 Nov 22 16:55:57.466580 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 481/974] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:55:57 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:00.435982 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-cb9e2031-cca5-4c4c-81d5-399da76a36b7 req-32fed40c-2d1d-4927-93ed-ba2df124c5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:00.437102 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:00.437499 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:00.437499 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:56:00.438208 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:00.446088 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-cb9e2031-cca5-4c4c-81d5-399da76a36b7 req-32fed40c-2d1d-4927-93ed-ba2df124c5f2 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:00.446538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-cb9e2031-cca5-4c4c-81d5-399da76a36b7 req-32fed40c-2d1d-4927-93ed-ba2df124c5f2 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:00.449454 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:00.450176 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:00.451375 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:00.452017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:00.457935 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-cb9e2031-cca5-4c4c-81d5-399da76a36b7 req-32fed40c-2d1d-4927-93ed-ba2df124c5f2 service nova] Creating event network-changed:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:56:00.463498 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-cb9e2031-cca5-4c4c-81d5-399da76a36b7 req-32fed40c-2d1d-4927-93ed-ba2df124c5f2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030883 Nov 22 16:56:00.464150 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 482/975] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:56:00.480957 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:56:00.576529 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-92d7d15b-3f18-41a6-89ad-114874e65b60 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "DELETE /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 204 len: 0 microversion: 2.1 time: 0.145855 Nov 22 16:56:00.582371 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 494/976] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:56:00 2021] DELETE /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:56:00.588300 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:00.589735 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:00.596588 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:00.597213 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:00.598551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:00.598551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:00.757862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:00.765928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3bd94bab-5d8d-42de-a116-8d05d225edeb tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1566 microversion: 2.1 time: 0.182106 Nov 22 16:56:00.767895 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 483/977] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:00 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:56:01.785366 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:01.786205 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:01.792792 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:01.793239 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:01.794019 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:01.794454 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:01.939149 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:01.948410 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9f56ad24-4913-43df-8384-b07acdc7a0c3 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1449 microversion: 2.1 time: 0.167082 Nov 22 16:56:01.948997 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 495/978] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:01 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1449 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:02.786424 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-37d5a4b0-2c6c-4981-a413-608e8a6e9b23 req-5401a677-5cbc-456b-b293-8690f2709432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c", "name": "network-vif-deleted", "tag": "ca92a526-e007-4012-b65d-6d1bd8f760b9"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:02.788503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:02.788503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:56:02.796273 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-37d5a4b0-2c6c-4981-a413-608e8a6e9b23 req-5401a677-5cbc-456b-b293-8690f2709432 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:02.796723 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-37d5a4b0-2c6c-4981-a413-608e8a6e9b23 req-5401a677-5cbc-456b-b293-8690f2709432 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:02.809507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-37d5a4b0-2c6c-4981-a413-608e8a6e9b23 req-5401a677-5cbc-456b-b293-8690f2709432 service nova] Creating event network-vif-deleted:ca92a526-e007-4012-b65d-6d1bd8f760b9 for instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c on hv-cinder-80473 Nov 22 16:56:02.814705 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-37d5a4b0-2c6c-4981-a413-608e8a6e9b23 req-5401a677-5cbc-456b-b293-8690f2709432 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031912 Nov 22 16:56:02.815309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 484/979] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:02.965711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:02.966347 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:02.972686 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:02.973139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:02.973912 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:02.974368 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:03.035806 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b3ae21dd4f4202996b0a99416ef766', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a162bba81c545e78b24734acd4f95e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:03.044218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-49ea51ef-ec15-4f4a-a5b0-d37dfa1fdd8f tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 200 len: 1219 microversion: 2.1 time: 0.082358 Nov 22 16:56:03.044798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 496/980] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:02 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:04.063215 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:04.064034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [instance: 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:04.070113 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:04.070561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:04.071328 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:04.071759 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:04.085529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] HTTP exception thrown: Instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c could not be found. Nov 22 16:56:04.085818 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Returning 404 to user: Instance 76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:56:04.086626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cbe44ba4-be27-4908-9fe3-14df4b35e971 tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c" status: 404 len: 111 microversion: 2.1 time: 0.027839 Nov 22 16:56:04.087165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 485/981] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:04 2021] GET /compute/v2.1/servers/76d6fc47-65e1-42ec-b4b1-2e38ad8eaa1c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 16:56:04.244311 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cea9b9e1-7862-4b56-bf56-9c5b0e1a0afd tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] Calling method '.version_select at 0x7fc695155b80>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:04.247757 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cea9b9e1-7862-4b56-bf56-9c5b0e1a0afd tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [b2540a95-6590-4080-b15a-43456b221908] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 16:56:05.264561 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [None req-cea9b9e1-7862-4b56-bf56-9c5b0e1a0afd tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] [b2540a95-6590-4080-b15a-43456b221908] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 40430. Nov 22 16:56:05.284102 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cea9b9e1-7862-4b56-bf56-9c5b0e1a0afd tempest-TestShelveInstance-336301834 tempest-TestShelveInstance-336301834-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-155879003" status: 202 len: 0 microversion: 2.1 time: 1.044322 Nov 22 16:56:05.284675 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 497/982] 10.222.0.61 () {58 vars in 1250 bytes} [Mon Nov 22 16:56:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-155879003 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:56:12.979492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1920043286", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1382229380", "security_groups": [{"name": "tempest-secgroup-smoke-1121951638"}], "block_device_mapping_v2": [{"uuid": "4c4cbf4d-092c-450c-9636-a0d9bc1a7131", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0b1c2e1e-d8e0-430c-9638-c1f4446f26b2"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:13.089089 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] validate_networks() for [('0b1c2e1e-d8e0-430c-9638-c1f4446f26b2', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:56:13.464805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:56:13.465226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:56:13.465698 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:56:13.466130 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:56:13.466541 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:56:13.475065 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:13.475443 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:13.476283 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:13.476713 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:13.496528 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for project dd6bb6026ac74775904d68f7483c79c8. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:56:13.500348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Getting quotas for user 431675338a834fcda7bc05e51ac001a1 and project dd6bb6026ac74775904d68f7483c79c8. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:56:13.554929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:56:13.557068 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c4cbf4d-092c-450c-9636-a0d9bc1a7131',volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:56:13.677308 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-317ad408-2210-4002-a744-a65889322fc2 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701515 Nov 22 16:56:13.677987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 486/983] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:56:12 2021] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:56:13.688385 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b17e670f-6faf-4127-bfd1-84ea6b24d361 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:13.689010 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b17e670f-6faf-4127-bfd1-84ea6b24d361 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:13.747024 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b17e670f-6faf-4127-bfd1-84ea6b24d361 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:13.753450 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b17e670f-6faf-4127-bfd1-84ea6b24d361 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1095 microversion: 2.1 time: 0.069257 Nov 22 16:56:13.754024 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 498/984] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:13 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:14.773660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:14.774278 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:14.780912 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:14.781365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:14.782148 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:14.782585 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:14.843710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:14.856247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-08f3b4db-1c98-431b-a0f4-9dcadf0e9b90 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1211 microversion: 2.1 time: 0.087187 Nov 22 16:56:14.856859 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 487/985] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:14 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:15.356447 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 16:56:15.356956 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 16:56:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 16:56:15.872822 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:15.873704 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:15.880285 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:15.880849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:15.881728 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:15.882900 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:16.031475 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:16.038700 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-39a29cc7-ecb9-4c3c-9ee7-dec28ca824fd req-489d0cdb-e57b-49e9-aa4c-5c69ab15d668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba", "tag": "d9295e93-3475-4c90-980c-39f91b792592"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:16.040465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:16.040465 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:56:16.044474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-44a1239b-a945-42d4-8228-36d9ae91abdb tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.174938 Nov 22 16:56:16.045447 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 499/986] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:15 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:16.051002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-39a29cc7-ecb9-4c3c-9ee7-dec28ca824fd req-489d0cdb-e57b-49e9-aa4c-5c69ab15d668 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:16.051592 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-39a29cc7-ecb9-4c3c-9ee7-dec28ca824fd req-489d0cdb-e57b-49e9-aa4c-5c69ab15d668 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:16.067386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-39a29cc7-ecb9-4c3c-9ee7-dec28ca824fd req-489d0cdb-e57b-49e9-aa4c-5c69ab15d668 service nova] Creating event network-changed:d9295e93-3475-4c90-980c-39f91b792592 for instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba on hv-cinder-80473 Nov 22 16:56:16.073587 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-39a29cc7-ecb9-4c3c-9ee7-dec28ca824fd req-489d0cdb-e57b-49e9-aa4c-5c69ab15d668 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040423 Nov 22 16:56:16.074472 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 488/987] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:17.062171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:17.062881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:17.070502 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:17.070949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:17.071736 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:17.072188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:17.210796 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:17.218814 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-857c6c52-ca1f-4ee5-9ba8-b74308aa4539 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.160177 Nov 22 16:56:17.219395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 500/988] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:17 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:18.236552 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:18.237166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:18.244252 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:18.244696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:18.245505 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:18.245952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:18.549157 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:18.558760 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3face538-a21e-4d03-9ab0-f8eade45949b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.326160 Nov 22 16:56:18.559356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 489/989] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:18 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:19.431011 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 16:56:19.431610 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 16:56:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 16:56:19.575689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:19.576330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:19.582905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:19.583356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:19.584174 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:19.584614 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:19.768217 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:19.775508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-13b6baf6-501b-4e0f-9af7-8f1f3c1de3ca tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.203463 Nov 22 16:56:19.776108 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 501/990] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:19 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:20.792516 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:20.793133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:20.799445 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:20.799934 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:20.800720 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:20.801160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:20.942235 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:20.950460 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f3f2c19a-bacc-46e7-94d6-8b29b08905fe tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.162025 Nov 22 16:56:20.951035 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 490/991] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:20 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:21.967072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:21.967681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:21.973742 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:21.974186 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:21.974967 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:21.975397 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:22.104612 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:22.111849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-101dd33b-44af-4cdf-b446-2d309d315593 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.148653 Nov 22 16:56:22.112421 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 502/992] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:21 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:23.129237 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:23.129853 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:23.137031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:23.137486 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:23.138277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:23.138755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:23.277098 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:23.284446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4d52450f-a0ac-44cc-9467-6e1e7051f54a tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.158986 Nov 22 16:56:23.285013 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 491/993] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:23 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:24.300990 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:24.301710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:24.309156 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:24.309690 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:24.310487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:24.310928 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:24.443964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:24.452541 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-775c1b39-f3af-49b8-87a8-d5bfd8a2d0aa tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.155334 Nov 22 16:56:24.453114 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 503/994] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:24 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:25.469395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:25.470002 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:25.477866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:25.478644 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:25.480063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:25.480867 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:25.612825 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:25.620518 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cbcdcb9e-3459-40d6-9343-445705ca8443 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.154799 Nov 22 16:56:25.621077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 492/995] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:25 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:26.374436 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-2ba6c974-a5ea-4a13-b050-bb951838f680 req-7cc3b180-9ec9-4428-80b8-ad5bceb6a36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba", "name": "network-vif-plugged", "status": "completed", "tag": "d9295e93-3475-4c90-980c-39f91b792592"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:26.376056 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:26.376056 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:56:26.383236 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2ba6c974-a5ea-4a13-b050-bb951838f680 req-7cc3b180-9ec9-4428-80b8-ad5bceb6a36b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:26.383676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-2ba6c974-a5ea-4a13-b050-bb951838f680 req-7cc3b180-9ec9-4428-80b8-ad5bceb6a36b service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:26.395220 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-2ba6c974-a5ea-4a13-b050-bb951838f680 req-7cc3b180-9ec9-4428-80b8-ad5bceb6a36b service nova] Creating event network-vif-plugged:d9295e93-3475-4c90-980c-39f91b792592 for instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba on hv-cinder-80473 Nov 22 16:56:26.400401 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-2ba6c974-a5ea-4a13-b050-bb951838f680 req-7cc3b180-9ec9-4428-80b8-ad5bceb6a36b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029494 Nov 22 16:56:26.400996 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 504/996] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:26.637897 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:26.638413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:26.644755 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:26.645209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:26.646003 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:26.646441 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:26.784053 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:26.791475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-48904499-2040-43e2-9d5f-4b044323e854 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1267 microversion: 2.1 time: 0.157276 Nov 22 16:56:26.792078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 493/997] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:26 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:27.810462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:27.811511 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:27.818561 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:27.818794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:27.820623 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:27.821260 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:27.957748 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:27.966557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-672eabe3-19e7-4c8b-934b-9f1005122d89 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1454 microversion: 2.1 time: 0.161602 Nov 22 16:56:27.967122 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 505/998] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:27 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:56:27.982279 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:27.982890 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:27.989080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:27.989535 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:27.990316 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:27.990750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:28.125933 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:28.134160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-01ce5403-3c25-427b-96e4-b003212cde40 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1454 microversion: 2.1 time: 0.155445 Nov 22 16:56:28.134722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 494/999] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:27 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:29.748674 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-5462943f-7dca-4373-b83d-a952067371b2 req-7707c58e-49ad-432b-b9d9-2907519b7189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba", "tag": "d9295e93-3475-4c90-980c-39f91b792592"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:29.751287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:29.751287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:56:29.760302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-5462943f-7dca-4373-b83d-a952067371b2 req-7707c58e-49ad-432b-b9d9-2907519b7189 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:29.760745 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-5462943f-7dca-4373-b83d-a952067371b2 req-7707c58e-49ad-432b-b9d9-2907519b7189 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:29.771530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-5462943f-7dca-4373-b83d-a952067371b2 req-7707c58e-49ad-432b-b9d9-2907519b7189 service nova] Creating event network-changed:d9295e93-3475-4c90-980c-39f91b792592 for instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba on hv-cinder-80473 Nov 22 16:56:29.776663 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-5462943f-7dca-4373-b83d-a952067371b2 req-7707c58e-49ad-432b-b9d9-2907519b7189 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031696 Nov 22 16:56:29.777463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 506/1000] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:35.700463 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:35.701404 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:35.707582 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:35.708057 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:35.708835 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:35.709758 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:35.737983 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1f4080be-ede5-4b6f-954b-4767a402e621 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041177 Nov 22 16:56:35.738533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 495/1001] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:56:35 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:56:35.794250 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:35.794829 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:35.801005 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:35.801449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:35.802221 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:35.802647 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:35.826622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:56:35.900259 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b4cef6cb-4064-4be4-9fd5-fd44728e61eb tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 204 len: 0 microversion: 2.1 time: 0.109990 Nov 22 16:56:35.900870 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 507/1002] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:56:35 2021] DELETE /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:56:35.908706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:35.909349 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:35.915367 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:35.915813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:35.916609 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:35.917041 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:36.050368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:36.058083 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6d71f2e6-ea5e-4f43-b04a-d604418e61e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1672 microversion: 2.1 time: 0.152890 Nov 22 16:56:36.058659 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 496/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:35 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:56:37.076474 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:37.077206 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:37.083469 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:37.083952 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:37.084951 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:37.085396 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:37.219798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:37.227384 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-e6b66da4-00fa-4c31-8db9-fef517c2cf43 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1672 microversion: 2.1 time: 0.154924 Nov 22 16:56:37.227971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 508/1004] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:37 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:38.245334 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:38.245952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:38.252060 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:38.252517 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:38.253311 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:38.253756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:38.387561 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:38.394857 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-4b17f5a1-673a-439e-b961-5bd87352d971 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1672 microversion: 2.1 time: 0.154150 Nov 22 16:56:38.395413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 497/1005] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:38 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:39.069036 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-10c706b9-481e-4df5-aec6-7a0c80a2e2a9 req-34018584-ed7a-4aab-b57e-575113e93fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6517240b-6ef9-466c-88ac-6e73bd2f771c", "name": "network-vif-deleted", "tag": "8fb0874e-fcbc-4cce-87ba-7923e791f22c"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:39.070411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:39.070411 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:56:39.079344 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-10c706b9-481e-4df5-aec6-7a0c80a2e2a9 req-34018584-ed7a-4aab-b57e-575113e93fa4 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:39.079798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-10c706b9-481e-4df5-aec6-7a0c80a2e2a9 req-34018584-ed7a-4aab-b57e-575113e93fa4 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:39.092731 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-10c706b9-481e-4df5-aec6-7a0c80a2e2a9 req-34018584-ed7a-4aab-b57e-575113e93fa4 service nova] Creating event network-vif-deleted:8fb0874e-fcbc-4cce-87ba-7923e791f22c for instance 6517240b-6ef9-466c-88ac-6e73bd2f771c on hv-cinder-80473 Nov 22 16:56:39.098225 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-10c706b9-481e-4df5-aec6-7a0c80a2e2a9 req-34018584-ed7a-4aab-b57e-575113e93fa4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033465 Nov 22 16:56:39.098964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 509/1006] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:39.414475 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:39.415152 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:39.421565 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:39.422029 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:39.422819 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:39.423260 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:39.456386 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:39.456840 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:39.457281 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lazy-loading 'fault' on Instance uuid 6517240b-6ef9-466c-88ac-6e73bd2f771c {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:56:39.497781 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:39.507039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-15a26704-cea9-4047-ab1f-c5c2863121b1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 200 len: 1326 microversion: 2.1 time: 0.096790 Nov 22 16:56:39.507948 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 498/1007] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:39 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:40.525054 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:40.525729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:40.532134 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:40.532581 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:40.533349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:40.533805 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:40.548092 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] HTTP exception thrown: Instance 6517240b-6ef9-466c-88ac-6e73bd2f771c could not be found. Nov 22 16:56:40.548676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Returning 404 to user: Instance 6517240b-6ef9-466c-88ac-6e73bd2f771c could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:56:40.549491 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-38b2c38d-fcca-422c-8add-79b9029e0946 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 404 len: 111 microversion: 2.1 time: 0.029034 Nov 22 16:56:40.550032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 510/1008] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:40 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:56:40.558043 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-56776fae-72d8-41ec-96e5-cddca2d96a75 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '.version_select at 0x7fc6951c4280>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:40.578923 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-56776fae-72d8-41ec-96e5-cddca2d96a75 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914323773" status: 202 len: 0 microversion: 2.1 time: 0.024311 Nov 22 16:56:40.579488 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 499/1009] 10.222.0.61 () {58 vars in 1220 bytes} [Mon Nov 22 16:56:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1914323773 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:56:41.212950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-790f5171-91d8-47a1-8234-23ced829af33 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: .version_select at 0x7fc6951a2550>, body: {"keypair": {"name": "tempest-keypair-305594895"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:41.227307 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-790f5171-91d8-47a1-8234-23ced829af33 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:56:41.231158 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-790f5171-91d8-47a1-8234-23ced829af33 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for user df00753d984e4802a40872c78398aabb and project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:56:41.569669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-790f5171-91d8-47a1-8234-23ced829af33 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:56:41.573444 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-790f5171-91d8-47a1-8234-23ced829af33 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for user df00753d984e4802a40872c78398aabb and project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:56:41.586227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-790f5171-91d8-47a1-8234-23ced829af33 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.377012 Nov 22 16:56:41.586840 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 511/1010] 10.222.0.61 () {60 vars in 1157 bytes} [Mon Nov 22 16:56:41 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:42.838830 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1726248483", "imageRef": "64611e4e-9b06-4296-b39c-7c3e3508b63d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a90a2625-3e1f-42ca-bb48-64439de3ab4b"}], "security_groups": [{"name": "tempest-securitygroup--1086594530"}], "key_name": "tempest-keypair-305594895", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:42.940071 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] validate_networks() for [('a90a2625-3e1f-42ca-bb48-64439de3ab4b', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:56:43.354821 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:56:43.355248 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:56:43.355710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:56:43.356146 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:56:43.356552 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:56:43.365014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:43.365534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:43.366345 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:43.366776 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:43.383603 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:56:43.387492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Getting quotas for user df00753d984e4802a40872c78398aabb and project 485536b21b4a4b2a9b004c7db3864b9a. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:56:43.399111 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:56:43.401427 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64611e4e-9b06-4296-b39c-7c3e3508b63d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:56:43.448731 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c9a10aff-eb55-4ee0-8457-3e85bd2ab510 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614737 Nov 22 16:56:43.449551 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 500/1011] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:56:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:56:43.460378 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fd4ca3e1-5a67-4cfd-862b-06f010e7f104 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:43.461109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fd4ca3e1-5a67-4cfd-862b-06f010e7f104 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:43.514879 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fd4ca3e1-5a67-4cfd-862b-06f010e7f104 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:43.522870 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fd4ca3e1-5a67-4cfd-862b-06f010e7f104 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1237 microversion: 2.1 time: 0.065777 Nov 22 16:56:43.523168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 512/1012] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:43 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:44.542796 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:44.543409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:44.551929 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:44.552395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:44.553773 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:44.554209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:44.618103 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:44.627136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-94418124-315c-4d89-836d-7d5c33b8dda6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1297 microversion: 2.1 time: 0.088590 Nov 22 16:56:44.627861 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 501/1013] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:44 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:45.644985 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:45.645533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:45.652486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:45.652936 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:45.653720 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:45.654154 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:46.055148 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:46.063669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-c3c8e6ba-b957-4110-b459-65c587af4eb6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.422326 Nov 22 16:56:46.065139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 513/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:45 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:46.080831 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-a50a28ab-3284-48a2-8c4a-b28f00f3cb73 req-c66f4d29-144f-4455-821b-e09bdf18e5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e39530a-2232-47f6-bf9d-bc13a672cf23", "tag": "a4790e7a-59c9-472a-86fe-1702c23f2bc8"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:46.082791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:46.082791 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:56:46.090846 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-a50a28ab-3284-48a2-8c4a-b28f00f3cb73 req-c66f4d29-144f-4455-821b-e09bdf18e5bb service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:46.091298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-a50a28ab-3284-48a2-8c4a-b28f00f3cb73 req-c66f4d29-144f-4455-821b-e09bdf18e5bb service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:46.103941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-a50a28ab-3284-48a2-8c4a-b28f00f3cb73 req-c66f4d29-144f-4455-821b-e09bdf18e5bb service nova] Creating event network-changed:a4790e7a-59c9-472a-86fe-1702c23f2bc8 for instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 on hv-cinder-80473 Nov 22 16:56:46.109027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-a50a28ab-3284-48a2-8c4a-b28f00f3cb73 req-c66f4d29-144f-4455-821b-e09bdf18e5bb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123459 Nov 22 16:56:46.109629 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 502/1015] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:56:47.081535 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:47.082141 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:47.088793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:47.089244 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:47.090293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:47.090725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:47.221337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:47.229268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1d185627-f820-43d3-9eff-c3a0ddfa96f2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.151375 Nov 22 16:56:47.229830 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 514/1016] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:47 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:48.247806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:48.248441 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:48.254547 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:48.254995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:48.255764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:48.256415 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:48.391165 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:48.399420 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cf4f787f-21fb-4453-b2b9-0a9e40b9bb01 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.156230 Nov 22 16:56:48.400026 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 503/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:48 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:49.417007 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:49.417554 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:49.423906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:49.424355 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:49.425130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:49.425567 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:49.556532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:49.566286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-93000a45-f335-42e9-a841-2c6bb5e9e1ae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.153445 Nov 22 16:56:49.569283 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 515/1018] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:49 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:50.582583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:50.583351 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:50.591484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:50.591973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:50.592768 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:50.593211 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:50.728678 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:50.736390 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ad329a52-0317-4496-9bf8-43f8412f8549 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.157704 Nov 22 16:56:50.736952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 504/1019] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:50 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:51.753224 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:51.753824 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:51.760235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:51.760716 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:51.761498 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:51.761932 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:51.895643 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:51.902901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-abe0d143-3156-4be1-a289-76f8e667b1b2 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.153335 Nov 22 16:56:51.903494 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 516/1020] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:51 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:52.482477 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-be9e664a-069b-4e2a-8c01-7fd8ba4af68a req-48f3d182-1865-4943-a87c-17b8a6e87778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39530a-2232-47f6-bf9d-bc13a672cf23", "name": "network-vif-plugged", "status": "completed", "tag": "a4790e7a-59c9-472a-86fe-1702c23f2bc8"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:52.484075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:52.484075 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:56:52.491758 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-be9e664a-069b-4e2a-8c01-7fd8ba4af68a req-48f3d182-1865-4943-a87c-17b8a6e87778 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:52.492176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-be9e664a-069b-4e2a-8c01-7fd8ba4af68a req-48f3d182-1865-4943-a87c-17b8a6e87778 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:52.503656 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-be9e664a-069b-4e2a-8c01-7fd8ba4af68a req-48f3d182-1865-4943-a87c-17b8a6e87778 service nova] Creating event network-vif-plugged:a4790e7a-59c9-472a-86fe-1702c23f2bc8 for instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 on hv-cinder-80473 Nov 22 16:56:52.509173 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-be9e664a-069b-4e2a-8c01-7fd8ba4af68a req-48f3d182-1865-4943-a87c-17b8a6e87778 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030286 Nov 22 16:56:52.509763 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 505/1021] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:52.919810 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:52.920465 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:52.926860 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:52.927302 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:52.928109 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:52.928536 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:53.056807 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:53.064028 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-dff863e0-185e-4c64-ac43-9c4dc09084fd tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1363 microversion: 2.1 time: 0.147966 Nov 22 16:56:53.064598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 517/1022] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:52 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:54.082484 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:54.083182 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:54.090583 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:54.091032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:54.091810 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:54.092265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:54.236058 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:56:54.244206 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8611b022-87e5-4576-9e65-1b14bb7b2f3f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1550 microversion: 2.1 time: 0.166249 Nov 22 16:56:54.244781 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 506/1023] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:56:54 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:56:54.260790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:56:54.261328 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:54.267576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:54.268063 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:54.268845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:54.269293 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:54.349405 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-131c03d8-e907-4216-b283-ab3c459fcc42 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092707 Nov 22 16:56:54.350226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 518/1024] 10.222.0.61 () {58 vars in 1274 bytes} [Mon Nov 22 16:56:54 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:56:55.294985 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:55.296069 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:55.297438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-d1b59624-e1f4-4eb8-9335-486a80955a08 req-b38762f6-ecf4-4984-a101-15e546653fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e39530a-2232-47f6-bf9d-bc13a672cf23", "tag": "a4790e7a-59c9-472a-86fe-1702c23f2bc8"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:55.299363 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:56:55.299363 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:56:55.303410 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:55.303965 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:55.304807 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:55.305320 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:55.308373 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d1b59624-e1f4-4eb8-9335-486a80955a08 req-b38762f6-ecf4-4984-a101-15e546653fbf service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:55.308819 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-d1b59624-e1f4-4eb8-9335-486a80955a08 req-b38762f6-ecf4-4984-a101-15e546653fbf service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:55.321770 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-d1b59624-e1f4-4eb8-9335-486a80955a08 req-b38762f6-ecf4-4984-a101-15e546653fbf service nova] Creating event network-changed:a4790e7a-59c9-472a-86fe-1702c23f2bc8 for instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 on hv-cinder-80473 Nov 22 16:56:55.327291 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-d1b59624-e1f4-4eb8-9335-486a80955a08 req-b38762f6-ecf4-4984-a101-15e546653fbf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033797 Nov 22 16:56:55.328115 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 519/1025] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:56:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:56:55.408305 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c1ac3e87-2c30-4d89-871b-fa1d0ad05508 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.116923 Nov 22 16:56:55.409124 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 507/1026] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:56:55 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:56:56.420352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:56.421472 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:56.428578 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:56.429287 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:56.430121 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:56.430530 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:56.524919 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cd417898-18a2-4c1f-9cd6-da546d67406b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.108897 Nov 22 16:56:56.525576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 520/1027] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:56:56 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:56:57.536208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:57.537197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:57.545063 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:57.545508 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:57.546295 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:57.546729 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:57.634546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3219f146-9ceb-4672-8797-420665bc9cae tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.102168 Nov 22 16:56:57.635187 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 508/1028] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:56:57 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:56:58.645710 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:58.646627 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:58.654193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:58.654648 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:58.655434 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:58.655899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:58.739928 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8e79b322-0b45-44d2-8a72-458ef58141e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.098089 Nov 22 16:56:58.741052 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 521/1029] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:56:58 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:56:59.751918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:56:59.752915 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:56:59.760481 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:59.760932 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:59.761713 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:56:59.762152 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:56:59.843044 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8e34d3df-3d25-43da-87d4-7a237656478d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.094831 Nov 22 16:56:59.843584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 509/1030] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:56:59 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:00.854846 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:00.855916 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:00.862825 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:00.863360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:00.865267 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:00.866617 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:00.953753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cf6e19c1-1704-495e-b830-21ffa39cac8f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.103280 Nov 22 16:57:00.954425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 522/1031] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:00 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:01.965905 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:01.966901 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:01.973683 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:01.974130 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:01.975558 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:01.976039 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:02.056241 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2fa03adf-3ef3-4a9e-bcdd-a60d5b14cee8 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.094512 Nov 22 16:57:02.056866 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 510/1032] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:01 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:03.067992 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:03.069130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:03.076175 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:03.076661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:03.077446 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:03.077885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:03.159540 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d37e66c3-19b1-4cb1-95c1-2f790c1fb548 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.095418 Nov 22 16:57:03.160229 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 523/1033] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:03 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:04.170860 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:04.171874 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:04.179298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:04.179749 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:04.180576 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:04.181000 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:04.266257 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2de29229-6467-4af1-971e-f7e6f24743ef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.099164 Nov 22 16:57:04.266829 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 511/1034] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:04 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:05.277608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:05.278515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:05.285315 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:05.285764 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:05.286533 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:05.286963 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:05.368532 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-08947189-b783-4edd-a770-37693b5e23d7 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 14 microversion: 2.1 time: 0.094812 Nov 22 16:57:05.369184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 524/1035] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:05 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:06.380034 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:06.380991 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:06.388636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:06.389090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:06.389882 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:06.390326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:06.490569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-54b8bf78-5d2e-4290-95c2-6d4ccdf1e19d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 12411 microversion: 2.1 time: 0.114453 Nov 22 16:57:06.491428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 512/1036] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:06 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 12411 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:07.502341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:07.503337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:07.510352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:07.510803 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:07.511582 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:07.512045 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:07.610997 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-58005e3e-4157-49fc-a581-7a5b7f668727 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 18449 microversion: 2.1 time: 0.112501 Nov 22 16:57:07.611671 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 525/1037] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:07 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 18449 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:08.623050 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:08.624104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:08.631797 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:08.632414 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:08.633160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:08.633595 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:08.720710 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7b665cb4-770a-432d-9c06-3fa656369bbf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 19342 microversion: 2.1 time: 0.101462 Nov 22 16:57:08.721675 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 513/1038] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:08 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 19342 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:09.732681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:09.733673 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:09.740552 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:09.741728 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:09.742523 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:09.742957 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:09.830136 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2846d650-cbb6-4662-b4ce-87dd4fc7c52e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 21972 microversion: 2.1 time: 0.101129 Nov 22 16:57:09.830698 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 526/1039] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:09 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 21972 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:10.842491 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:10.843492 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:10.850990 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:10.851445 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:10.852278 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:10.852718 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:10.949371 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3ec29210-2e04-4f2e-8e44-bd7e3d03cf98 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 23235 microversion: 2.1 time: 0.111025 Nov 22 16:57:10.950046 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 514/1040] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:10 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 23235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:11.960970 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:11.961971 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:11.969057 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:11.969508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:11.970288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:11.970732 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:12.058070 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-25485de2-e8fe-4702-9001-bb7b189b735d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 24832 microversion: 2.1 time: 0.101125 Nov 22 16:57:12.059017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 527/1041] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:11 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 24832 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:13.070906 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:13.072072 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:13.078852 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:13.079297 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:13.080104 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:13.080538 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:13.173383 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-453c3a01-f91f-44a5-aa21-8718282cf32a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 26449 microversion: 2.1 time: 0.107069 Nov 22 16:57:13.174021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 515/1042] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:13 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 26449 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:14.185390 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:14.186408 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:14.193168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:14.194179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:14.194953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:14.195386 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:14.294180 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2e6cd695-a1e6-462e-a9c7-c3c8d3d60be1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 27513 microversion: 2.1 time: 0.112494 Nov 22 16:57:14.294745 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 528/1043] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:14 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 27513 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:15.306792 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:15.307753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:15.314655 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:15.315113 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:15.315920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:15.316358 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:15.411127 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-b5f44dbd-8a41-4ba8-af89-f7c565b40cef tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 27968 microversion: 2.1 time: 0.108793 Nov 22 16:57:15.411777 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 516/1044] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:15 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 27968 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:16.423137 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:16.424068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:16.431017 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:16.431462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:16.432266 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:16.432696 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:16.529953 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7bea3f9c-e81e-40a9-a2b1-95768a53682a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28222 microversion: 2.1 time: 0.110763 Nov 22 16:57:16.530606 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 529/1045] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:16 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:17.542950 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:17.543963 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:17.550770 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:17.551218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:17.552027 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:17.552496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:17.640433 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6cdbe5de-9d51-4289-8f1f-2c61e44ae2be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28222 microversion: 2.1 time: 0.101376 Nov 22 16:57:17.641090 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 517/1046] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:17 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:18.653336 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:18.654353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:18.661294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:18.661753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:18.663173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:18.663764 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:18.763407 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-21f0bb4f-8bb2-4902-8a7c-9593d15559cc tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28513 microversion: 2.1 time: 0.114062 Nov 22 16:57:18.764341 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 530/1047] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:18 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28513 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:19.775707 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:19.776764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:19.784537 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:19.784995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:19.785790 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:19.786223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:19.880745 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-39f2a021-2b4c-44ba-9521-df35c3bb3a11 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28681 microversion: 2.1 time: 0.109306 Nov 22 16:57:19.881829 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 518/1048] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:19 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28681 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:20.893672 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:20.894768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:20.902263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:20.902711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:20.903538 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:20.904015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:20.990066 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5007382c-bd18-43ec-ba24-6cc17c2e0d4c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28681 microversion: 2.1 time: 0.100295 Nov 22 16:57:20.991458 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 531/1049] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:20 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28681 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:22.002751 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:22.003782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:22.011375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:22.011857 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:22.012654 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:22.013093 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:22.099917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-1f4f820d-1205-4b6b-9725-9cbcfaa932bf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28681 microversion: 2.1 time: 0.100926 Nov 22 16:57:22.100962 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 519/1050] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:21 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28681 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:23.112138 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:23.113163 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:23.120853 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:23.121297 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:23.122076 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:23.122505 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:23.207212 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a7d79c03-2cdd-47ba-8f1c-5e9262a8986e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 28681 microversion: 2.1 time: 0.098890 Nov 22 16:57:23.208865 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 532/1051] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:23 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 28681 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:24.219696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:24.220671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:24.228326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:24.228804 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:24.229584 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:24.230021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:24.328703 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-9fa40f62-7d7e-446a-bb9c-00e0dfc0c6d6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 29804 microversion: 2.1 time: 0.113276 Nov 22 16:57:24.329379 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 520/1052] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:24 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 29804 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:25.341564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:25.342486 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:25.349894 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:25.350342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:25.351133 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:25.351568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:25.449893 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-af7bc6ff-abcd-47f3-bd01-61ce0f69c7ad tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 31515 microversion: 2.1 time: 0.112675 Nov 22 16:57:25.450803 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 533/1053] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:25 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 31515 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:57:26.463869 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:26.464877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:26.471248 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:26.471696 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:26.472509 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:26.481334 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:26.563743 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d25eefe3-cf92-4d75-94b9-b248146c5b67 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 32974 microversion: 2.1 time: 0.106354 Nov 22 16:57:26.564431 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 521/1054] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:26 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 32974 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:27.576177 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:27.577171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:27.583984 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:27.584517 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:27.585313 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:27.585746 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:27.685519 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-73a0d882-de9c-465e-bc79-119dcff27187 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 33833 microversion: 2.1 time: 0.113069 Nov 22 16:57:27.686730 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 534/1055] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:27 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 33833 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 16:57:28.698490 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:28.699537 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:28.706434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:28.706887 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:28.707673 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:28.708138 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:28.801569 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7184cb27-4227-49dd-b186-c6f0c172de09 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 34944 microversion: 2.1 time: 0.107386 Nov 22 16:57:28.802227 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 522/1056] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:28 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 34944 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:29.814035 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:29.814938 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:29.823001 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:29.823452 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:29.824262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:29.824700 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:29.924278 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-75688dda-3eca-4dfb-9160-ba12e825444a tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 36255 microversion: 2.1 time: 0.114113 Nov 22 16:57:29.924928 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 535/1057] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:29 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 36255 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:30.937666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:30.938683 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:30.945588 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:30.946038 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:30.946833 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:30.947267 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:31.042014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-83bd1778-e58a-4fd0-8ad6-89eec7a3e80d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 37911 microversion: 2.1 time: 0.108317 Nov 22 16:57:31.046092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 523/1058] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:30 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 37911 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:32.054925 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:32.055958 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:32.062959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:32.063416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:32.064245 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:32.064687 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:32.157888 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-086e0b39-2e4f-4e5d-8872-e1001e691f7c tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 38214 microversion: 2.1 time: 0.107332 Nov 22 16:57:32.158571 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 536/1059] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:32 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 38214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:33.170249 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:33.171282 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:33.178363 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:33.178939 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:33.179726 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:33.180196 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:33.263978 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-6e661153-17fc-4069-91a1-ff59acaf210e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 38214 microversion: 2.1 time: 0.097564 Nov 22 16:57:33.264759 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 524/1060] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:33 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 38214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:34.277326 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:34.278243 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:34.285450 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:34.285905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:34.286688 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:34.287158 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:34.371192 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0b547a3f-4728-4410-9a48-2c0193bcc487 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 38214 microversion: 2.1 time: 0.097934 Nov 22 16:57:34.372140 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 537/1061] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:34 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 38214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:35.383894 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:35.384844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:35.391806 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:35.392285 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:35.393082 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:35.393519 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:35.483621 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5d45dcf4-fcb0-42f0-92fd-bd0169b1a28d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action" status: 200 len: 38345 microversion: 2.1 time: 0.103882 Nov 22 16:57:35.484313 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 525/1062] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 16:57:35 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/action => generated 38345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 16:57:35.495432 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:35.496043 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:35.502937 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:35.503391 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:35.504197 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:35.504629 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:35.529273 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1890f241-3c6b-4ac9-8d76-037ba1d7649f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/ips" status: 200 len: 147 microversion: 2.1 time: 0.038755 Nov 22 16:57:35.529850 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 538/1063] 10.222.0.61 () {58 vars in 1247 bytes} [Mon Nov 22 16:57:35 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:36.837216 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ac9d174-fb4b-4623-9536-c08ed33f5b2a"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:36.838342 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:36.845486 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:36.845960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:36.846744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:36.847176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:37.250899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a4d86a63-db5d-4868-ba06-3a20903e54e1 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417609 Nov 22 16:57:37.251499 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 526/1064] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:57:36 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:44.717930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:44.719514 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:44.727193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:44.727636 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:44.728445 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:44.728878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:44.758729 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0fe41a78-47b0-4852-a9b8-133bd446d02f tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Nov 22 16:57:44.759274 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 539/1065] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:57:44 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:44.769376 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:44.769961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:44.776974 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:44.777430 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:44.778218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:44.778660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:44.807310 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3000398a-d9dc-480e-9778-5ca096084a12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/5ac9d174-fb4b-4623-9536-c08ed33f5b2a" status: 200 len: 194 microversion: 2.1 time: 0.041957 Nov 22 16:57:44.807911 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 527/1066] 10.222.0.61 () {58 vars in 1412 bytes} [Mon Nov 22 16:57:44 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/5ac9d174-fb4b-4623-9536-c08ed33f5b2a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:46.128578 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "724a4b8d-a3e6-4906-bb32-68fd18b4f313"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:57:46.129616 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:46.136794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:46.137249 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:46.138032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:46.138470 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:46.389085 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5e981bc4-9dcc-4cc0-95ac-dad459569e79 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263983 Nov 22 16:57:46.389685 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 540/1067] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 16:57:46 2021] POST /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:53.848594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:53.849681 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:53.855999 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:53.856453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:53.857236 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:53.857669 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:53.888109 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a2611ab2-9f6f-4182-90a3-9364cdbb14e0 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043235 Nov 22 16:57:53.888571 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 528/1068] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:57:53 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:54.218620 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:54.219203 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:54.225958 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:54.226421 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:54.227235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:54.227670 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:54.257849 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-f3114b98-ac28-447c-ac3a-31582e5b8a78 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/5ac9d174-fb4b-4623-9536-c08ed33f5b2a" status: 200 len: 194 microversion: 2.1 time: 0.044058 Nov 22 16:57:54.258463 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 541/1069] 10.222.0.61 () {58 vars in 1412 bytes} [Mon Nov 22 16:57:54 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/5ac9d174-fb4b-4623-9536-c08ed33f5b2a => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:54.267854 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:54.268360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:54.275539 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:54.276021 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:54.276807 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:54.277368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:54.355024 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lazy-loading 'services' on Instance uuid 4e39530a-2232-47f6-bf9d-bc13a672cf23 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:57:54.424174 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-49e654e4-da4a-4640-8f40-df2d175de55b tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/5ac9d174-fb4b-4623-9536-c08ed33f5b2a" status: 202 len: 0 microversion: 2.1 time: 0.159797 Nov 22 16:57:54.424746 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 529/1070] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:57:54 2021] DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/5ac9d174-fb4b-4623-9536-c08ed33f5b2a => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:57:56.588569 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:56.589096 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:56.595650 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:56.596129 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:56.596910 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:56.597337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:56.628184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2c1d97c3-8866-4be9-ad82-2e8f60d7bb41 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/724a4b8d-a3e6-4906-bb32-68fd18b4f313" status: 200 len: 194 microversion: 2.1 time: 0.044470 Nov 22 16:57:56.628859 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 542/1071] 10.222.0.61 () {58 vars in 1412 bytes} [Mon Nov 22 16:57:56 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/724a4b8d-a3e6-4906-bb32-68fd18b4f313 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:57:56.639533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:56.640135 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:56.646208 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:56.646654 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:56.648732 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:56.649197 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:56.729795 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lazy-loading 'services' on Instance uuid 4e39530a-2232-47f6-bf9d-bc13a672cf23 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:57:56.799617 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a12d45f9-a611-4123-8d28-dedeab77145d tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/724a4b8d-a3e6-4906-bb32-68fd18b4f313" status: 202 len: 0 microversion: 2.1 time: 0.164404 Nov 22 16:57:56.800268 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 530/1072] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 16:57:56 2021] DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments/724a4b8d-a3e6-4906-bb32-68fd18b4f313 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 16:57:57.955570 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:57.956547 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:57.962899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:57.963343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:57.964153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:57.964592 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:57.993255 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4f7b596e-7b28-4f97-acb9-db0cfd85e2a9 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041430 Nov 22 16:57:57.993814 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 543/1073] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:57:57 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:58.094801 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:58.095960 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:58.102782 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:58.103243 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:58.104062 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:58.104507 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:58.134594 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e03c1fd6-e5b5-407b-824f-d49804c36557 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044511 Nov 22 16:57:58.135145 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 531/1074] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 16:57:58 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 16:57:58.191016 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:58.191507 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:58.197774 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:58.198216 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:58.198992 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:58.199426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:58.223230 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:57:58.301018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4cad45fd-7fa2-4f2d-932f-a3361104c0cf tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 204 len: 0 microversion: 2.1 time: 0.112095 Nov 22 16:57:58.302190 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 544/1075] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:57:58 2021] DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:57:58.311621 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:58.312266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:58.318058 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:58.318511 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:58.319987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:58.320434 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:58.453131 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:57:58.461265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a28863da-8239-47ad-be2f-1d053f2e96e6 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1675 microversion: 2.1 time: 0.153215 Nov 22 16:57:58.461920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 532/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:57:58 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:57:59.479471 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:57:59.480202 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:57:59.486599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:59.487045 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:59.487845 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:57:59.488284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:57:59.627168 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:57:59.635526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-560e30ac-7654-4586-94f4-be05cdb45264 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1675 microversion: 2.1 time: 0.160306 Nov 22 16:57:59.637177 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 545/1077] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:57:59 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:00.654365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:00.654998 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:00.661598 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:00.662324 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:00.663526 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:00.664156 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:00.752192 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:00.760360 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f9a8d347-394c-4399-bea2-d084bdc90af3 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1607 microversion: 2.1 time: 0.110520 Nov 22 16:58:00.761166 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 533/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:00 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1607 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:01.326572 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-9e4cd5a2-151b-48cb-a412-eb371b546725 req-5a287516-cc79-4869-bf59-8292efc6ad41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e39530a-2232-47f6-bf9d-bc13a672cf23", "name": "network-vif-deleted", "tag": "a4790e7a-59c9-472a-86fe-1702c23f2bc8"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:58:01.328227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:58:01.328227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 16:58:01.336481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-9e4cd5a2-151b-48cb-a412-eb371b546725 req-5a287516-cc79-4869-bf59-8292efc6ad41 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:01.337019 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-9e4cd5a2-151b-48cb-a412-eb371b546725 req-5a287516-cc79-4869-bf59-8292efc6ad41 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:01.349801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-9e4cd5a2-151b-48cb-a412-eb371b546725 req-5a287516-cc79-4869-bf59-8292efc6ad41 service nova] Creating event network-vif-deleted:a4790e7a-59c9-472a-86fe-1702c23f2bc8 for instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 on hv-cinder-80473 Nov 22 16:58:01.360692 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-9e4cd5a2-151b-48cb-a412-eb371b546725 req-5a287516-cc79-4869-bf59-8292efc6ad41 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037915 Nov 22 16:58:01.361433 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 546/1079] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:58:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:58:01.778032 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:01.778689 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:01.785403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:01.785849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:01.786727 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:01.787175 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:01.823668 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:01.824157 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:01.824612 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lazy-loading 'fault' on Instance uuid 4e39530a-2232-47f6-bf9d-bc13a672cf23 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:58:01.867322 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df00753d984e4802a40872c78398aabb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '485536b21b4a4b2a9b004c7db3864b9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:01.874494 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e08b4da0-7b58-4274-b211-13a5ed18ae51 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 200 len: 1327 microversion: 2.1 time: 0.100178 Nov 22 16:58:01.875249 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 534/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:01 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:02.893066 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:02.893769 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:02.900676 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:02.901130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:02.901918 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:02.902360 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:02.915557 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] HTTP exception thrown: Instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 could not be found. Nov 22 16:58:02.916182 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Returning 404 to user: Instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:02.917012 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4bfe3122-76e8-4654-b648-12acb46e17a5 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 404 len: 111 microversion: 2.1 time: 0.028408 Nov 22 16:58:02.917563 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 547/1081] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:02 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:02.925651 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2c29042e-b766-4072-bc3f-a3d5d5ba99be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '.version_select at 0x7fc6951a8430>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:02.944820 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2c29042e-b766-4072-bc3f-a3d5d5ba99be tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-305594895" status: 202 len: 0 microversion: 2.1 time: 0.022007 Nov 22 16:58:02.945406 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 535/1082] 10.222.0.61 () {58 vars in 1217 bytes} [Mon Nov 22 16:58:02 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-305594895 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:58:05.842425 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:05.843281 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:05.850473 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:05.851227 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:05.852072 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:05.852518 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:05.867018 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] HTTP exception thrown: Instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 could not be found. Nov 22 16:58:05.867622 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Returning 404 to user: Instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:05.868481 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-326a31aa-c36f-43d3-aa8d-aba7d52bae7e tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 404 len: 111 microversion: 2.1 time: 0.029739 Nov 22 16:58:05.869041 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 548/1083] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:58:05 2021] DELETE /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:05.876764 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:05.877403 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 4e39530a-2232-47f6-bf9d-bc13a672cf23] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:05.883947 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:05.884399 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:05.885190 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:05.885626 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:05.899446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] HTTP exception thrown: Instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 could not be found. Nov 22 16:58:05.899998 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Returning 404 to user: Instance 4e39530a-2232-47f6-bf9d-bc13a672cf23 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:05.900822 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5e387cec-64c1-469d-bb35-a8ffcbd48416 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23" status: 404 len: 111 microversion: 2.1 time: 0.027773 Nov 22 16:58:05.901357 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 536/1084] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:05 2021] GET /compute/v2.1/servers/4e39530a-2232-47f6-bf9d-bc13a672cf23 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:07.030441 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:07.030979 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:07.037351 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:07.038593 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:07.039519 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:07.039991 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:07.052990 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] HTTP exception thrown: Instance 6517240b-6ef9-466c-88ac-6e73bd2f771c could not be found. Nov 22 16:58:07.054552 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Returning 404 to user: Instance 6517240b-6ef9-466c-88ac-6e73bd2f771c could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:07.055370 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-97dda94d-131e-4972-8d3a-1f2354e0d022 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 404 len: 111 microversion: 2.1 time: 0.028684 Nov 22 16:58:07.055921 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 549/1085] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:58:07 2021] DELETE /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:07.063640 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:07.064298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] [instance: 6517240b-6ef9-466c-88ac-6e73bd2f771c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:07.070928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:07.071453 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:07.072308 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:07.072750 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:07.085739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] HTTP exception thrown: Instance 6517240b-6ef9-466c-88ac-6e73bd2f771c could not be found. Nov 22 16:58:07.086318 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] Returning 404 to user: Instance 6517240b-6ef9-466c-88ac-6e73bd2f771c could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:07.087125 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-2fb93016-b479-4f86-8726-cfc85e787d12 tempest-AttachVolumeTestJSON-860532305 tempest-AttachVolumeTestJSON-860532305-project] 10.222.0.61 "GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c" status: 404 len: 111 microversion: 2.1 time: 0.027159 Nov 22 16:58:07.087649 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 537/1086] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:07 2021] GET /compute/v2.1/servers/6517240b-6ef9-466c-88ac-6e73bd2f771c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:09.325399 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:09.325847 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:09.333267 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:09.333726 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:09.335304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:09.335756 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:09.353502 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-4c1854e5-3ec3-4f86-a726-37ebf4f8a508 req-ad782f31-0aea-4549-9cd3-36d6b169243c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba", "tag": "d9295e93-3475-4c90-980c-39f91b792592"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:58:09.355928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:58:09.355928 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:58:09.364888 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-4c1854e5-3ec3-4f86-a726-37ebf4f8a508 req-ad782f31-0aea-4549-9cd3-36d6b169243c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:09.365336 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-4c1854e5-3ec3-4f86-a726-37ebf4f8a508 req-ad782f31-0aea-4549-9cd3-36d6b169243c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:09.371550 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:58:09.379982 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-4c1854e5-3ec3-4f86-a726-37ebf4f8a508 req-ad782f31-0aea-4549-9cd3-36d6b169243c service nova] Creating event network-changed:d9295e93-3475-4c90-980c-39f91b792592 for instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba on hv-cinder-80473 Nov 22 16:58:09.387218 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-4c1854e5-3ec3-4f86-a726-37ebf4f8a508 req-ad782f31-0aea-4549-9cd3-36d6b169243c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039048 Nov 22 16:58:09.401332 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 538/1087] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:58:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 16:58:09.461346 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fb27e1c1-331d-4d70-866c-3eeef134ce9b tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 204 len: 0 microversion: 2.1 time: 0.139398 Nov 22 16:58:09.466173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 550/1088] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:58:09 2021] DELETE /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:58:09.471534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:09.472346 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:09.482191 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:09.483040 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:09.484115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:09.484761 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:09.777619 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:09.799461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-87d79fec-f34b-4610-a5a1-354de37793e4 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1578 microversion: 2.1 time: 0.332186 Nov 22 16:58:09.802579 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 539/1089] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:09 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1578 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:10.817537 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:10.818379 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:10.828347 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:10.828908 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:10.829794 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:10.830343 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:11.032211 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:11.040609 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-d578c147-8ba4-446a-88ae-5241d1677505 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1460 microversion: 2.1 time: 0.226887 Nov 22 16:58:11.041862 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 551/1090] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:10 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1460 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:11.615073 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-bd08b005-4bf8-47c1-8648-f33e0c4e152b req-f8a5de40-4469-4fbe-926e-7120428b2671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba", "name": "network-vif-deleted", "tag": "d9295e93-3475-4c90-980c-39f91b792592"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:58:11.617754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:58:11.617754 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:58:11.626771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-bd08b005-4bf8-47c1-8648-f33e0c4e152b req-f8a5de40-4469-4fbe-926e-7120428b2671 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:11.627220 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-bd08b005-4bf8-47c1-8648-f33e0c4e152b req-f8a5de40-4469-4fbe-926e-7120428b2671 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:11.639591 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-bd08b005-4bf8-47c1-8648-f33e0c4e152b req-f8a5de40-4469-4fbe-926e-7120428b2671 service nova] Creating event network-vif-deleted:d9295e93-3475-4c90-980c-39f91b792592 for instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba on hv-cinder-80473 Nov 22 16:58:11.646096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-bd08b005-4bf8-47c1-8648-f33e0c4e152b req-f8a5de40-4469-4fbe-926e-7120428b2671 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034739 Nov 22 16:58:11.647346 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 540/1091] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:58:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:58:12.058319 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:12.059015 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:12.065521 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:12.065972 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:12.066766 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:12.067326 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:12.103044 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:12.103569 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:12.104119 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.objects.instance [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lazy-loading 'fault' on Instance uuid b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba {{(pid=133215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 16:58:12.148226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:12.155747 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-300d9080-7914-453e-8f1b-20141456e651 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 200 len: 1231 microversion: 2.1 time: 0.101197 Nov 22 16:58:12.156350 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 552/1092] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:12 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:13.173787 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:13.174482 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:13.181577 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:13.182030 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:13.182813 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:13.183247 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:13.197674 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] HTTP exception thrown: Instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba could not be found. Nov 22 16:58:13.198262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Returning 404 to user: Instance b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:13.199083 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-03d5baa5-2789-4ec1-8ff8-18fe7aec6e94 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba" status: 404 len: 111 microversion: 2.1 time: 0.029794 Nov 22 16:58:13.199624 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 541/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:13 2021] GET /compute/v2.1/servers/b9d4e062-cf0c-4a26-b0e2-6d9c7ed45fba => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:16.521892 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:16.523265 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:16.530640 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-a86ab737-4d81-4b1d-8b02-60220a704ea6 req-bd279a30-f6b8-4b5f-9880-ede595eede32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24575018-194c-419c-8c58-1f7c89a4b192", "tag": "10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:58:16.532280 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:58:16.532280 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:58:16.539934 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:16.540390 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:16.540967 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-a86ab737-4d81-4b1d-8b02-60220a704ea6 req-bd279a30-f6b8-4b5f-9880-ede595eede32 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:16.541184 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:16.541619 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:16.541739 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-a86ab737-4d81-4b1d-8b02-60220a704ea6 req-bd279a30-f6b8-4b5f-9880-ede595eede32 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:16.552913 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-a86ab737-4d81-4b1d-8b02-60220a704ea6 req-bd279a30-f6b8-4b5f-9880-ede595eede32 service nova] Creating event network-changed:10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7 for instance 24575018-194c-419c-8c58-1f7c89a4b192 on hv-cinder-80473 Nov 22 16:58:16.558668 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-a86ab737-4d81-4b1d-8b02-60220a704ea6 req-bd279a30-f6b8-4b5f-9880-ede595eede32 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031491 Nov 22 16:58:16.559534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 542/1094] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:58:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:58:16.570097 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 16:58:16.656644 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-7a001e00-aaff-45c6-8229-470ebd362d54 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 204 len: 0 microversion: 2.1 time: 0.138059 Nov 22 16:58:16.657128 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 553/1095] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:58:16 2021] DELETE /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 16:58:16.666721 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:16.667417 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:16.673429 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:16.673877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:16.674652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:16.675081 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:16.811285 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:16.818688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f9b5947e-a262-4488-9a46-7b3d1d15d535 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1578 microversion: 2.1 time: 0.156590 Nov 22 16:58:16.819938 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 543/1096] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:16 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:17.837793 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:17.838406 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:17.844947 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:17.845390 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:17.846177 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:17.846608 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:17.980333 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:17.987723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-83a50407-f900-413a-9436-09eb10dc8218 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1578 microversion: 2.1 time: 0.154366 Nov 22 16:58:17.988322 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 554/1097] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:17 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:19.004477 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:19.005065 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:19.011998 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:19.012448 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:19.013232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:19.013666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:19.149742 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:19.157133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-caf00908-2ad3-4d8a-b2bb-e996fd5677ad tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1459 microversion: 2.1 time: 0.156301 Nov 22 16:58:19.157685 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 544/1098] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:18 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1459 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:58:20.174284 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:20.174895 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:20.181885 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:20.182339 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:20.183131 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:20.183568 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:20.321669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431675338a834fcda7bc05e51ac001a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd6bb6026ac74775904d68f7483c79c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:58:20.331395 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-07654109-e336-4ecb-959a-647a9b66838e tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 200 len: 1459 microversion: 2.1 time: 0.159287 Nov 22 16:58:20.335312 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 555/1099] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:20 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 16:58:20.447877 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-a7aa7ae1-4689-4fbc-8485-73c680d1a2d7 req-9fe34771-098c-4ba8-9933-2672c20d87ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24575018-194c-419c-8c58-1f7c89a4b192", "name": "network-vif-deleted", "tag": "10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:58:20.449380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 16:58:20.449380 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 16:58:20.459091 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-a7aa7ae1-4689-4fbc-8485-73c680d1a2d7 req-9fe34771-098c-4ba8-9933-2672c20d87ba service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:20.459691 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-a7aa7ae1-4689-4fbc-8485-73c680d1a2d7 req-9fe34771-098c-4ba8-9933-2672c20d87ba service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:20.473393 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-a7aa7ae1-4689-4fbc-8485-73c680d1a2d7 req-9fe34771-098c-4ba8-9933-2672c20d87ba service nova] Creating event network-vif-deleted:10b34e7c-7d5c-4d3f-bc3c-c7515447e4d7 for instance 24575018-194c-419c-8c58-1f7c89a4b192 on hv-cinder-80473 Nov 22 16:58:20.478989 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-a7aa7ae1-4689-4fbc-8485-73c680d1a2d7 req-9fe34771-098c-4ba8-9933-2672c20d87ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035159 Nov 22 16:58:20.480395 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 545/1100] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 16:58:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 16:58:21.349560 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:21.350157 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 24575018-194c-419c-8c58-1f7c89a4b192] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:21.355926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:21.356375 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:21.357144 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:21.357573 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:21.519788 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] HTTP exception thrown: Instance 24575018-194c-419c-8c58-1f7c89a4b192 could not be found. Nov 22 16:58:21.520416 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Returning 404 to user: Instance 24575018-194c-419c-8c58-1f7c89a4b192 could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:21.521226 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b228d816-a398-43b4-8fbc-562d566ac761 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192" status: 404 len: 111 microversion: 2.1 time: 0.175485 Nov 22 16:58:21.521762 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 556/1101] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:21 2021] GET /compute/v2.1/servers/24575018-194c-419c-8c58-1f7c89a4b192 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:21.988309 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:21.988900 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:21.996017 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:21.996479 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:21.998503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:21.998503 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:22.011296 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] HTTP exception thrown: Instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c could not be found. Nov 22 16:58:22.011925 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Returning 404 to user: Instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:22.012766 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-98bb5e6c-a8b2-4a34-8343-3618d05caaa6 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 404 len: 111 microversion: 2.1 time: 0.028471 Nov 22 16:58:22.013318 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 546/1102] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 16:58:21 2021] DELETE /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:22.021230 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:22.022353 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] [instance: 4565565d-eecf-4bc1-8f80-5b7098b1ee3c] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:58:22.028669 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:22.029121 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:22.029899 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:58:22.030337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:58:22.044022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.wsgi [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] HTTP exception thrown: Instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c could not be found. Nov 22 16:58:22.044602 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Returning 404 to user: Instance 4565565d-eecf-4bc1-8f80-5b7098b1ee3c could not be found. {{(pid=133215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 16:58:22.045414 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-1cfbbb49-c3c9-4a40-8c4d-b7fe356d7195 tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c" status: 404 len: 111 microversion: 2.1 time: 0.027848 Nov 22 16:58:22.045936 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 557/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:58:22 2021] GET /compute/v2.1/servers/4565565d-eecf-4bc1-8f80-5b7098b1ee3c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 16:58:23.323450 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7d705b55-3e36-45ea-8138-44e6938009fd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] Calling method '.version_select at 0x7fc6952204c0>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:58:23.342428 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7d705b55-3e36-45ea-8138-44e6938009fd tempest-TestVolumeBootPattern-1338524742 tempest-TestVolumeBootPattern-1338524742-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1382229380" status: 202 len: 0 microversion: 2.1 time: 0.022556 Nov 22 16:58:23.343449 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 547/1104] 10.222.0.61 () {58 vars in 1262 bytes} [Mon Nov 22 16:58:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1382229380 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 16:59:39.449116 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 16:59:39.449727 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 16:59:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 16:59:41.817590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 16:59:41.818238 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 16:59:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 16:59:47.319664 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Action: 'create', calling method: .version_select at 0x7fc695110430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-431230174"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:59:47.332514 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Getting quotas for project 54ae85780780466c945807684ff5e61d. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:59:47.338243 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Getting quotas for user d6efaa5903ac42018524ba01679f67ea and project 54ae85780780466c945807684ff5e61d. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:59:47.351071 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [b2540a95-6590-4080-b15a-43456b221908] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 16:59:48.367886 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [b2540a95-6590-4080-b15a-43456b221908] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 41966. Nov 22 16:59:48.468100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Getting quotas for project 54ae85780780466c945807684ff5e61d. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:59:48.471915 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.quota [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Getting quotas for user d6efaa5903ac42018524ba01679f67ea and project 54ae85780780466c945807684ff5e61d. Resources: {'key_pairs'} {{(pid=133215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:59:48.485272 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-4d82b4ec-7fed-4404-8d28-d8134659f143 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.171618 Nov 22 16:59:48.485897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 558/1105] 10.222.0.61 () {60 vars in 1157 bytes} [Mon Nov 22 16:59:47 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:48.534590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1701381956", "imageRef": "1839a414-d51c-4bd7-a345-c6094ce461cf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-431230174", "networks": [{"uuid": "8f830bed-f7c5-4a20-b178-18ac7ea2bc75"}]}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 16:59:48.585200 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.network.neutron [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] validate_networks() for [('8f830bed-f7c5-4a20-b178-18ac7ea2bc75', None, None, None, None, None)] {{(pid=133216) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 16:59:48.955633 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Flavor limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 16:59:48.956096 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Image limits 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 16:59:48.956578 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Flavor pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 16:59:48.956987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Image pref 0:0:0 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 16:59:48.957400 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.virt.hardware [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=133216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 16:59:48.966975 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:48.967426 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:48.968294 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:48.968737 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:48.985262 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Getting quotas for project 54ae85780780466c945807684ff5e61d. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 16:59:48.989160 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.quota [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Getting quotas for user d6efaa5903ac42018524ba01679f67ea and project 54ae85780780466c945807684ff5e61d. Resources: {'ram', 'cores', 'instances'} {{(pid=133216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 16:59:49.000408 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Going to run 1 instances... {{(pid=133216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 16:59:49.002741 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1839a414-d51c-4bd7-a345-c6094ce461cf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=133216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 16:59:49.049177 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-7681535f-a62c-4dad-ab55-81ea7b997f2a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519245 Nov 22 16:59:49.049817 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 548/1106] 10.222.0.61 () {60 vars in 1146 bytes} [Mon Nov 22 16:59:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 16:59:49.059381 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-18eaa0d7-3e21-423d-b9b0-411b0ebc39d3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:49.060024 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-18eaa0d7-3e21-423d-b9b0-411b0ebc39d3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:49.114209 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-18eaa0d7-3e21-423d-b9b0-411b0ebc39d3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:49.121987 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-18eaa0d7-3e21-423d-b9b0-411b0ebc39d3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1258 microversion: 2.1 time: 0.066170 Nov 22 16:59:49.122642 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 559/1107] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:49 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:50.139416 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:50.140087 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:50.146688 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:50.147254 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:50.148078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:50.148521 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:50.211137 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:50.224566 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-3a1c4800-414c-4503-90ee-679fd68e7a1d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1318 microversion: 2.1 time: 0.089677 Nov 22 16:59:50.235305 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 549/1108] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:50 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:51.242751 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:51.244769 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:51.251904 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:51.252452 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:51.253528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:51.254039 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:51.430326 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:51.439576 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9e384593-3e50-488f-b712-9a4bb4dae0c5 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.200838 Nov 22 16:59:51.440790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 560/1109] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:51 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:52.458524 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:52.459640 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:52.467099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:52.467557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:52.468390 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:52.468832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:52.617105 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:52.624881 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8fd5b428-50b8-4431-9db8-5c76c125c689 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.170357 Nov 22 16:59:52.625610 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 550/1110] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:52 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:53.642711 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:53.643282 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:53.649699 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:53.650155 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:53.650946 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:53.651387 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:53.793801 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:53.806717 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-fe53fff4-b235-4425-b844-fababa0ca38d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.167417 Nov 22 16:59:53.807410 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 561/1111] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:53 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:54.824400 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:54.825011 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:54.831368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:54.831848 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:54.832668 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:54.833115 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:54.974694 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:54.983231 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-f2c00889-6389-4781-b885-094103452cdb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.162475 Nov 22 16:59:54.983805 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 551/1112] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:54 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:56.000467 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:56.001090 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:56.007723 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:56.008210 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:56.009008 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:56.009452 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:56.159451 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:56.167753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-465df68d-03f0-4908-961e-7ec7675b4302 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.170774 Nov 22 16:59:56.168583 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 562/1113] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:55 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:57.185232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:57.185890 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:57.192728 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:57.193312 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:57.194216 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:57.194724 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:57.336411 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:57.344393 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-34df0855-71fa-41cb-b8dc-892cf2d7f9da tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.162726 Nov 22 16:59:57.344964 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 552/1114] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:57 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:58.363152 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:58.363897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:58.371671 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:58.372151 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:58.372941 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:58.373372 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:58.511960 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:58.519484 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b38f20ff-c15d-4c99-9a04-8d06369fd20b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.160579 Nov 22 16:59:58.520298 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 563/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:58 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 16:59:59.536356 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 16:59:59.537101 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 16:59:59.543856 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:59.544314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:59.545219 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 16:59:59.545747 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 16:59:59.697265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 16:59:59.706078 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-d5b414c4-d7eb-4710-ad86-7b0657d95718 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.173311 Nov 22 16:59:59.706698 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 553/1116] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 16:59:59 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:00.723753 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:00.724449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:00.731426 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:00.731906 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:00.732689 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:00.733122 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:00.870073 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:00.877476 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-61c3ac21-9516-43a2-9ca9-1fd17626db3f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.157602 Nov 22 17:00:00.878041 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 564/1117] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:00 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:01.130734 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-1497b5be-3714-4d2d-98c7-146b69a6a14d req-09f1362a-4067-43ae-b6c9-79c64e6aca69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:01.133250 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:00:01.133250 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 17:00:01.142143 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-1497b5be-3714-4d2d-98c7-146b69a6a14d req-09f1362a-4067-43ae-b6c9-79c64e6aca69 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:01.144264 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-1497b5be-3714-4d2d-98c7-146b69a6a14d req-09f1362a-4067-43ae-b6c9-79c64e6aca69 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:01.158835 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-1497b5be-3714-4d2d-98c7-146b69a6a14d req-09f1362a-4067-43ae-b6c9-79c64e6aca69 service nova] Creating event network-changed:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:00:01.165014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-1497b5be-3714-4d2d-98c7-146b69a6a14d req-09f1362a-4067-43ae-b6c9-79c64e6aca69 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039598 Nov 22 17:00:01.166277 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 554/1118] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:00:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:00:01.894224 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:01.894926 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:01.902198 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:01.902651 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:01.903438 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:01.903905 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:02.043179 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:02.056048 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-9410481e-33ca-484b-94c7-5a08cb5f8e3c tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.165007 Nov 22 17:00:02.057096 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 565/1119] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:01 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:03.077705 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:03.078425 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:03.085368 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:03.085794 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:03.086589 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:03.087028 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:03.226918 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:03.234353 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-0f945335-0584-4f4e-ad51-d3fef6ef0ffc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.161094 Nov 22 17:00:03.234915 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 555/1120] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:03 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:04.251420 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:04.252032 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:04.258574 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:04.259027 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:04.259834 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:04.260288 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:04.392041 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:04.400881 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b66a2225-392e-45bc-8dc4-81737f026c7f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.153196 Nov 22 17:00:04.401449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 566/1121] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:04 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:05.417840 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:05.418452 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:05.424733 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:05.425180 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:05.425973 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:05.426407 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:05.577653 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:05.585679 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ef9a2e43-e732-4fcc-9f9b-32938291d59b tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.171581 Nov 22 17:00:05.586223 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 556/1122] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:05 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:06.158663 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-4042c7b7-d7d1-4d75-8a9f-a45b02874aca req-6ae64ace-e1b5-4c53-b3e0-978439ea2f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "name": "network-vif-plugged", "status": "completed", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:06.160247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:00:06.160247 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 17:00:06.168218 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-4042c7b7-d7d1-4d75-8a9f-a45b02874aca req-6ae64ace-e1b5-4c53-b3e0-978439ea2f30 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:06.168661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-4042c7b7-d7d1-4d75-8a9f-a45b02874aca req-6ae64ace-e1b5-4c53-b3e0-978439ea2f30 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:06.184296 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-4042c7b7-d7d1-4d75-8a9f-a45b02874aca req-6ae64ace-e1b5-4c53-b3e0-978439ea2f30 service nova] Creating event network-vif-plugged:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:00:06.189424 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-4042c7b7-d7d1-4d75-8a9f-a45b02874aca req-6ae64ace-e1b5-4c53-b3e0-978439ea2f30 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176584 Nov 22 17:00:06.190003 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 567/1123] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:00:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:00:06.602647 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:06.603288 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:06.609686 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:06.610136 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:06.610917 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:06.611353 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:06.754354 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:06.762574 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-36b87a59-7cd2-4a93-862c-b78624dc2e4e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1358 microversion: 2.1 time: 0.164166 Nov 22 17:00:06.763158 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 557/1124] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:06 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:07.780356 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:07.781049 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:07.788022 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:07.788471 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:07.789264 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:07.789690 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:07.921779 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:07.929352 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-cd5d39a7-fe1f-44a1-83e0-a49a0f07dfaf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1549 microversion: 2.1 time: 0.153013 Nov 22 17:00:07.929913 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 568/1125] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:07 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:07.945523 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:07.946397 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:07.952546 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:07.953077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:07.953882 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:07.954327 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:08.081246 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:08.089653 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-cb295e95-ee5d-45a5-b167-40561c5ff7fe tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1549 microversion: 2.1 time: 0.148184 Nov 22 17:00:08.090290 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 558/1126] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:07 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 17:00:08.106235 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:08.109551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:00:08.109551 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 17:00:08.110584 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:08.111321 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Searching by: {'deleted': False, 'project_id': '54ae85780780466c945807684ff5e61d'} {{(pid=133215) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 22 17:00:08.118193 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:08.118634 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:08.119434 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:08.119897 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:08.211271 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.multi_cell_list [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=133215) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 22 17:00:08.313613 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5e03a57c-9d3f-44c0-9cd1-6722d202f0b8 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210756 Nov 22 17:00:08.314107 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 569/1127] 10.222.0.61 () {58 vars in 1124 bytes} [Mon Nov 22 17:00:08 2021] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:00:08.329414 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:08.330033 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:08.338396 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:08.339135 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:08.340496 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:08.341183 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:08.478097 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:08.486010 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a987813d-1c05-4190-b4fb-44bf682a2670 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1549 microversion: 2.1 time: 0.160217 Nov 22 17:00:08.486915 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 559/1128] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:08 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:10.006599 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55516daf-5094-4c6b-8f43-b9b13d8b8af6"}} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:10.008130 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:10.014217 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:10.014670 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:10.015462 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:10.015923 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:10.268146 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-dcdf99b1-dc3e-4439-972e-ccd5fd301fca tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265163 Nov 22 17:00:10.268750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 570/1129] 10.222.0.61 () {60 vars in 1322 bytes} [Mon Nov 22 17:00:10 2021] POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:00:17.790054 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:17.790753 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:17.797534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:17.797993 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:17.798825 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:17.799355 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:17.935233 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:17.942963 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-55a2990a-67cd-4b2d-bd58-132b01198b46 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1595 microversion: 2.1 time: 0.157074 Nov 22 17:00:17.943531 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 560/1130] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:17 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:19.629858 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-342a6587-9c80-4a83-968e-982a3bfecbc6 req-cc8c3ac7-9e63-4400-a732-2f1ce78a855c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:19.631393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:00:19.631393 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 17:00:19.642055 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-342a6587-9c80-4a83-968e-982a3bfecbc6 req-cc8c3ac7-9e63-4400-a732-2f1ce78a855c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:19.643889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-342a6587-9c80-4a83-968e-982a3bfecbc6 req-cc8c3ac7-9e63-4400-a732-2f1ce78a855c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:19.657626 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-342a6587-9c80-4a83-968e-982a3bfecbc6 req-cc8c3ac7-9e63-4400-a732-2f1ce78a855c service nova] Creating event network-changed:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:00:19.663263 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-342a6587-9c80-4a83-968e-982a3bfecbc6 req-cc8c3ac7-9e63-4400-a732-2f1ce78a855c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037113 Nov 22 17:00:19.664418 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 571/1131] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:00:20.617652 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1140671479"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:20.619265 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:20.626674 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:20.627226 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:20.628133 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:20.628660 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:20.769413 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.network.security_group_api [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Adding security group b1327405-7ba8-42d7-bb1b-2b18e3a5a19d to port 51537d3d-dbc1-43ef-8f85-4501015a232e Nov 22 17:00:21.158638 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5bce9d36-1ad6-43c5-b7bc-2fe56d8c8f9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/action" status: 202 len: 0 microversion: 2.1 time: 0.546747 Nov 22 17:00:21.159169 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 561/1132] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 17:00:20 2021] POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 17:00:21.171658 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:21.173349 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:21.192588 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:21.193201 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:21.195421 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:21.195924 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:21.246529 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-29a4361b-133c-444a-8b1a-e63ed26bc797 req-6b66e4a3-2487-4234-9317-fc331b9f20ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:21.248365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:00:21.248365 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 17:00:21.257163 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-29a4361b-133c-444a-8b1a-e63ed26bc797 req-6b66e4a3-2487-4234-9317-fc331b9f20ed service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:21.258564 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-29a4361b-133c-444a-8b1a-e63ed26bc797 req-6b66e4a3-2487-4234-9317-fc331b9f20ed service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:21.276568 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-29a4361b-133c-444a-8b1a-e63ed26bc797 req-6b66e4a3-2487-4234-9317-fc331b9f20ed service nova] Creating event network-changed:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:00:21.282844 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-29a4361b-133c-444a-8b1a-e63ed26bc797 req-6b66e4a3-2487-4234-9317-fc331b9f20ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113014 Nov 22 17:00:21.283589 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 562/1133] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:00:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:00:21.392851 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:21.401613 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a52ee5ee-6a6d-4f12-9553-a80f3e36a649 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1759 microversion: 2.1 time: 0.235620 Nov 22 17:00:21.412236 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 572/1134] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:21 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1759 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:38.477408 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:00:38.478321 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:38.484446 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:38.484896 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:38.485666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:38.486099 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:38.555534 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-a227643e-e55a-4626-b1db-f40305a184b3 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/action" status: 202 len: 0 microversion: 2.1 time: 0.083358 Nov 22 17:00:38.558961 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 563/1135] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 17:00:38 2021] POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 17:00:38.564707 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:38.565878 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:38.572949 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:38.573653 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:38.575139 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:38.575580 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:38.724844 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:38.733546 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-5ce31cae-f940-421e-9651-31ee6a797dfc tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1751 microversion: 2.1 time: 0.173002 Nov 22 17:00:38.734068 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 573/1136] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:38 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:39.752172 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:39.752920 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:39.759816 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:39.760293 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:39.761074 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:39.761509 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:39.904394 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:39.912150 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-5bcebbf3-d2fa-411a-ad09-31e2afc3c72d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.164560 Nov 22 17:00:39.912706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 564/1137] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:39 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:40.928526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:40.929304 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:40.935445 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:40.935957 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:40.936727 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:40.937158 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:41.081564 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:41.089719 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-80748620-2477-4b31-afb6-fbaca4996ab2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.164856 Nov 22 17:00:41.090279 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 574/1138] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:40 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:42.107346 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:42.107985 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:42.114287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:42.114740 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:42.115520 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:42.115992 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:42.258744 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:42.266872 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ea2e31a2-f006-48ff-9892-1c6c212bd64a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.163178 Nov 22 17:00:42.267671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 565/1139] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:42 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:43.284417 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:43.284993 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:43.291607 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:43.292104 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:43.292896 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:43.293336 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:43.438526 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:43.446952 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2986228d-4473-4962-b177-1508037c9bee tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.166367 Nov 22 17:00:43.447512 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 575/1140] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:43 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:44.464418 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:44.465031 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:44.471352 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:44.471803 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:44.472870 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:44.473314 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:44.615604 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:44.624375 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-76ef5085-4670-4c3c-84c0-3156fd237a9e tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.164256 Nov 22 17:00:44.624941 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 566/1141] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:44 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:45.643357 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:45.643999 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:45.651634 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:45.652117 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:45.652901 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:45.653337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:45.800188 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:45.808400 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-756a5eee-96b4-4cba-97d7-0ef9e5b7d966 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.169383 Nov 22 17:00:45.808968 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 576/1142] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:45 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:46.825348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:46.825951 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:46.832181 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:46.832631 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:46.833401 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:46.833832 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:46.977613 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:46.985461 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-18d3360d-c40a-45d8-a3ba-c6e0b1db5c49 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.163737 Nov 22 17:00:46.986015 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 567/1143] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:46 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:48.002790 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:48.003458 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:48.010768 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:48.011256 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:48.012153 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:48.012639 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:48.155021 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:48.162930 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-b5cceeb9-b081-40f8-b5e5-2b0bbcee22f2 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.164139 Nov 22 17:00:48.163497 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 577/1144] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:47 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:49.179069 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:49.179671 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:49.186735 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:49.187176 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:49.187977 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:49.188409 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:49.329722 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:49.337468 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-191102c1-ad1a-403b-b8e3-0e7231b2566d tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1756 microversion: 2.1 time: 0.162031 Nov 22 17:00:49.338193 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 568/1145] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:49 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:00:50.354268 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:00:50.354814 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:00:50.361292 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:50.361735 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:50.362508 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:00:50.362940 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:00:50.503725 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:00:50.512487 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a489bc5e-f739-47c1-a5c8-7e4dafce95bf tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1759 microversion: 2.1 time: 0.161962 Nov 22 17:00:50.513061 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 578/1146] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:00:50 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1759 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:01:15.380711 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:01:15.381354 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 17:01:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:01:22.754871 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1140671479"}} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:01:22.755572 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:22.761305 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:22.761756 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:22.763102 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:22.763533 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:22.942173 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.network.security_group_api [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Removing security group b1327405-7ba8-42d7-bb1b-2b18e3a5a19d from port 51537d3d-dbc1-43ef-8f85-4501015a232e Nov 22 17:01:23.267287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-65e7d135-9786-4c0b-9cdb-04eed2cbe3a1 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/action" status: 202 len: 0 microversion: 2.1 time: 0.516258 Nov 22 17:01:23.268422 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 569/1147] 10.222.0.61 () {60 vars in 1277 bytes} [Mon Nov 22 17:01:22 2021] POST /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 17:01:23.278798 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [req-95ad6cf4-8ee7-498d-83fd-8f4395a86995 req-c0f9a1e1-91b7-4f71-a525-7dca66429c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:01:23.281681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:01:23.281681 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: warnings.warn(msg) Nov 22 17:01:23.291453 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-95ad6cf4-8ee7-498d-83fd-8f4395a86995 req-c0f9a1e1-91b7-4f71-a525-7dca66429c8f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:23.291964 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [req-95ad6cf4-8ee7-498d-83fd-8f4395a86995 req-c0f9a1e1-91b7-4f71-a525-7dca66429c8f service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:23.307503 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.compute.server_external_events [req-95ad6cf4-8ee7-498d-83fd-8f4395a86995 req-c0f9a1e1-91b7-4f71-a525-7dca66429c8f service nova] Creating event network-changed:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:01:23.313747 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [req-95ad6cf4-8ee7-498d-83fd-8f4395a86995 req-c0f9a1e1-91b7-4f71-a525-7dca66429c8f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041314 Nov 22 17:01:23.314687 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 579/1148] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:01:24.638209 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:24.638757 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:24.645636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:24.646092 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:24.646885 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:24.647326 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:24.729620 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.objects.instance [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lazy-loading 'services' on Instance uuid b27c4492-b9b7-4c7e-941a-913b4cf572c6 {{(pid=133216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 17:01:24.801549 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-8d901172-a7f6-464a-9d64-610e4620fa92 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments/55516daf-5094-4c6b-8f43-b9b13d8b8af6" status: 202 len: 0 microversion: 2.1 time: 0.168093 Nov 22 17:01:24.805287 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 570/1149] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 17:01:24 2021] DELETE /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments/55516daf-5094-4c6b-8f43-b9b13d8b8af6 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 17:01:24.812515 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:24.813528 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:24.820965 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:24.821449 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:24.822330 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:24.822781 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:24.856203 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-bd34b3a8-2096-4c54-9297-454c2f920545 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049298 Nov 22 17:01:24.856778 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 580/1150] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 17:01:24 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:01:25.343899 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-8140303d-fe5c-4ee9-bc56-3503f6bd217e req-5e0cfd55-9b99-42e6-bee7-87acac2f425c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:01:25.345438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:01:25.345438 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 17:01:25.353666 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-8140303d-fe5c-4ee9-bc56-3503f6bd217e req-5e0cfd55-9b99-42e6-bee7-87acac2f425c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:25.354106 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-8140303d-fe5c-4ee9-bc56-3503f6bd217e req-5e0cfd55-9b99-42e6-bee7-87acac2f425c service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:25.365849 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-8140303d-fe5c-4ee9-bc56-3503f6bd217e req-5e0cfd55-9b99-42e6-bee7-87acac2f425c service nova] Creating event network-changed:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:01:25.370597 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-8140303d-fe5c-4ee9-bc56-3503f6bd217e req-5e0cfd55-9b99-42e6-bee7-87acac2f425c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030981 Nov 22 17:01:25.371256 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 571/1151] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:01:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:01:25.868337 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:25.869189 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:25.875525 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:25.876012 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:25.876821 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:25.877253 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:25.906683 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-2fb78508-9e4b-4787-8f78-6cc676f82c5f tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042054 Nov 22 17:01:25.907262 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 581/1152] 10.222.0.61 () {58 vars in 1301 bytes} [Mon Nov 22 17:01:25 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 17:01:25.917952 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:25.918777 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:25.924987 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:25.925440 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:25.926230 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:25.926672 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:25.999771 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] HTTP exception thrown: Instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 is not attached to volume 55516daf-5094-4c6b-8f43-b9b13d8b8af6 Nov 22 17:01:26.000406 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Returning 404 to user: Instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 is not attached to volume 55516daf-5094-4c6b-8f43-b9b13d8b8af6 {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 17:01:26.001232 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-ccdd6101-1592-43db-a2ee-dfc315296652 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments/55516daf-5094-4c6b-8f43-b9b13d8b8af6" status: 404 len: 154 microversion: 2.1 time: 0.087897 Nov 22 17:01:26.001778 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 572/1153] 10.222.0.61 () {58 vars in 1415 bytes} [Mon Nov 22 17:01:25 2021] DELETE /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6/os-volume_attachments/55516daf-5094-4c6b-8f43-b9b13d8b8af6 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 17:01:27.129959 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:27.130456 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:27.136714 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:27.137173 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:27.138217 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:27.138661 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:27.163002 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Going to try to terminate instance {{(pid=133215) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 17:01:27.236724 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-8f593328-91af-4c23-94cc-a634b026a1fd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 204 len: 0 microversion: 2.1 time: 0.109775 Nov 22 17:01:27.237421 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 582/1154] 10.222.0.61 () {58 vars in 1238 bytes} [Mon Nov 22 17:01:27 2021] DELETE /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 17:01:27.245734 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:27.246346 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:27.252636 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:27.253087 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:27.253862 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:27.254298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:27.383988 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.policy [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133216) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:01:27.391725 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-c86da456-5f06-400b-b033-e49b849c4efd tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1555 microversion: 2.1 time: 0.149603 Nov 22 17:01:27.392298 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 573/1155] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:01:27 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:01:28.409276 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:28.409889 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:28.416100 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:28.416547 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:28.417321 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:28.417759 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:28.596955 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:01:28.604429 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-0a8705cd-69ab-4331-a1ae-6f7026f99450 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1555 microversion: 2.1 time: 0.199289 Nov 22 17:01:28.604986 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 583/1156] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:01:28 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1555 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 17:01:29.551348 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [req-ea6dc576-2704-46e9-b6df-6984dd28fe86 req-6707a1bf-79a3-4d07-b453-9f52b6223142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b27c4492-b9b7-4c7e-941a-913b4cf572c6", "name": "network-vif-deleted", "tag": "51537d3d-dbc1-43ef-8f85-4501015a232e"}]} {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 17:01:29.553266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 17:01:29.553266 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: warnings.warn(msg) Nov 22 17:01:29.562077 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-ea6dc576-2704-46e9-b6df-6984dd28fe86 req-6707a1bf-79a3-4d07-b453-9f52b6223142 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:29.562513 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [req-ea6dc576-2704-46e9-b6df-6984dd28fe86 req-6707a1bf-79a3-4d07-b453-9f52b6223142 service nova] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:29.573706 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.compute.server_external_events [req-ea6dc576-2704-46e9-b6df-6984dd28fe86 req-6707a1bf-79a3-4d07-b453-9f52b6223142 service nova] Creating event network-vif-deleted:51537d3d-dbc1-43ef-8f85-4501015a232e for instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 on hv-cinder-80473 Nov 22 17:01:29.579927 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [req-ea6dc576-2704-46e9-b6df-6984dd28fe86 req-6707a1bf-79a3-4d07-b453-9f52b6223142 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032512 Nov 22 17:01:29.580735 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 574/1157] 10.222.0.61 () {64 vars in 1317 bytes} [Mon Nov 22 17:01:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 17:01:29.625065 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:29.625065 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.compute.api [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133215) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:29.630864 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:29.631310 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:29.632125 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:29.632555 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG oslo_concurrency.lockutils [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:29.699201 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.policy [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6efaa5903ac42018524ba01679f67ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ae85780780466c945807684ff5e61d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=133215) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 17:01:29.707600 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-ba2af681-d348-436a-88f5-3e50498a922a tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 200 len: 1343 microversion: 2.1 time: 0.089599 Nov 22 17:01:29.708294 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 584/1158] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:01:29 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 1343 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 17:01:30.726381 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '>' {{(pid=133216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:30.727080 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.compute.api [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] [instance: b27c4492-b9b7-4c7e-941a-913b4cf572c6] Fetching instance by UUID {{(pid=133216) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 17:01:30.733557 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:30.734014 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:30.734794 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 17:01:30.735233 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG oslo_concurrency.lockutils [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Lock "1490884b-e421-4bd9-b0b4-86739bfd9ed6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=133216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 17:01:30.748995 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.wsgi [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] HTTP exception thrown: Instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 could not be found. Nov 22 17:01:30.749590 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: DEBUG nova.api.openstack.wsgi [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Returning 404 to user: Instance b27c4492-b9b7-4c7e-941a-913b4cf572c6 could not be found. {{(pid=133216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 17:01:30.750405 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO nova.api.openstack.requestlog [None req-e8b59b99-021f-4eca-bc52-6296bb0303cb tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6" status: 404 len: 111 microversion: 2.1 time: 0.028758 Nov 22 17:01:30.750940 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: [pid: 133216|app: 0|req: 575/1159] 10.222.0.61 () {58 vars in 1235 bytes} [Mon Nov 22 17:01:30 2021] GET /compute/v2.1/servers/b27c4492-b9b7-4c7e-941a-913b4cf572c6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 17:01:30.758750 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: DEBUG nova.api.openstack.wsgi [None req-a684c17d-69e8-4e50-9ac1-396db1604cb7 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] Calling method '.version_select at 0x7fc695113af0>' {{(pid=133215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 17:01:30.777342 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO nova.api.openstack.requestlog [None req-a684c17d-69e8-4e50-9ac1-396db1604cb7 tempest-TestMinimumBasicScenario-1599774120 tempest-TestMinimumBasicScenario-1599774120-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-431230174" status: 202 len: 0 microversion: 2.1 time: 0.022092 Nov 22 17:01:30.777947 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: [pid: 133215|app: 0|req: 585/1160] 10.222.0.61 () {58 vars in 1268 bytes} [Mon Nov 22 17:01:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-431230174 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 17:02:59.469950 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:02:59.470655 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 17:02:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:03:01.838573 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:03:01.839108 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 17:03:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:04:35.398705 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:04:35.399369 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 17:04:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:06:19.488598 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:06:19.489171 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 17:06:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:06:21.856708 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:06:21.857234 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 17:06:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:06:36.400752 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:06:36.401248 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 17:06:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:06:40.701968 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:06:40.702611 dv-cinder-804735-12-iscsi devstack@n-api.service[133216]: Mon Nov 22 17:06:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 17:06:43.286286 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 17:06:43.286816 dv-cinder-804735-12-iscsi devstack@n-api.service[133215]: Mon Nov 22 17:06:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!